Nov 02 09:52:22 devstack cinder-volume[75338]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:52:22 devstack cinder-volume[75338]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:52:22 devstack cinder-volume[75338]: we strongly recommend against using it for new projects. Nov 02 09:52:22 devstack cinder-volume[75338]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:52:22 devstack cinder-volume[75338]: framework. For more detail see Nov 02 09:52:22 devstack cinder-volume[75338]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:52:22 devstack cinder-volume[75338]: import eventlet # noqa Nov 02 09:52:25 devstack cinder-volume[75338]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:52:25 devstack cinder-volume[75338]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:52:25 devstack cinder-volume[75338]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:52:26 devstack cinder-volume[75338]: INFO dbcounter [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Registered counter for database cinder Nov 02 09:52:26 devstack cinder-volume[75338]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:26 devstack cinder-volume[75338]: DEBUG dbcounter [-] [75338] Writer thread running {{(pid=75338) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:52:26 devstack cinder-volume[75338]: INFO cinder.rpc [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:52:26 devstack cinder-volume[75338]: INFO cinder.rpc [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:27 devstack cinder-volume[75338]: INFO cinder.volume.manager [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Determined volume DB was empty at startup. Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG cinder.volume.manager [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75338) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:52:27 devstack cinder-volume[75338]: INFO cinder.volume.manager [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 09:52:27 devstack cinder-volume[75338]: WARNING stevedore.named [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:52:27 devstack cinder-volume[75338]: WARNING castellan.key_manager [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:52:27 devstack cinder-volume[75338]: WARNING cinder.keymgr.conf_key_mgr [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG cinder.volume.drivers.lvm [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75338) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_concurrency.processutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_concurrency.processutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] CMD "cinder-rtstool verify" returned: 0 in 0.465s {{(pid=75338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:27 devstack cinder-volume[75338]: INFO cinder.rpc [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 09:52:27 devstack cinder-volume[75338]: INFO cinder.rpc [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 09:52:27 devstack cinder-volume[75338]: WARNING stevedore.named [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:52:27 devstack cinder-volume[75338]: WARNING castellan.key_manager [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:52:27 devstack cinder-volume[75338]: INFO cinder.volume.manager [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:27 devstack cinder-volume[75338]: INFO oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Starting 1 workers Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Started child 75488 {{(pid=75338) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Full set of CONF: {{(pid=75338) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:52:27 devstack cinder-volume[75488]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] ******************************************************************************** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Configuration options gathered from: {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] ================================================================================ {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] allow_availability_zone_fallback = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] allow_compression_on_image_upload = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] allowed_direct_url_schemes = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] api_rate_limit = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] auth_strategy = keystone {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] az_cache_duration = 3600 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_availability_zone = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_host = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_stats_polling_interval = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backup_api_class = cinder.backup.api.API {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backup_name_template = backup-%s {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backup_use_same_host = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backup_use_temp_snapshot = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] chap_password = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] chap_username = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_internal_tenant_project_id = e23b987467c34404aade729d806e7bf0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_internal_tenant_user_id = 30048208c6fb456b80ffe7ae6b7a2877 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cloned_volume_same_az = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cluster = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] compression_format = gzip {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] compute_api_class = cinder.compute.nova.API {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] config_dir = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] config_source = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] control_exchange = openstack {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] debug = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] default_availability_zone = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] default_group_type = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] default_volume_type = lvmdriver-1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] disk_geometry = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] driver_client_cert = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] driver_client_cert_key = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] driver_data_namespace = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] driver_ssl_cert_path = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] driver_ssl_cert_verify = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] driver_use_ssl = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] enable_force_upload = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] enable_new_services = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] enable_unsupported_driver = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] enforce_multipath_for_image_xfer = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] filter_function = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_api_insecure = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_api_ssl_compression = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_ca_certificates_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_catalog_info = image:glance:publicURL {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_num_retries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance_request_timeout = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] goodness_function = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] graceful_shutdown_timeout = 5 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] group_api_class = cinder.group.api.API {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] host = devstack {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_compress_on_upload = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_conversion_address_space_limit = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_conversion_cpu_limit = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_conversion_disable = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_introspection_address_space_limit = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_introspection_cpu_limit = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_upload_use_cinder_backend = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_upload_use_internal_tenant = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_volume_cache_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_volume_cache_max_count = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] image_volume_cache_max_size_gb = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] init_host_max_objects_retrieval = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] instance_format = [instance: %(uuid)s] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] iscsi_target_flags = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] iscsi_write_cache = on {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] iser_helper = tgtadm {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] iser_ip_address = 192.168.122.208 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] iser_port = 3260 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_color = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_config_append = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_dir = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_options = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_rotate_interval = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_rotate_interval_type = days {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] log_rotation_type = none {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] max_age = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] max_logfile_count = 30 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] max_logfile_size_mb = 200 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] max_over_subscription_ratio = 20.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] message_reap_interval = 86400 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] message_ttl = 2592000 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] migration_create_volume_timeout_secs = 300 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] monkey_patch = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] monkey_patch_modules = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] my_ip = 192.168.122.208 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] no_snapshot_gb_quota = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] num_iser_scan_tries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] num_shell_tries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] num_volume_device_scan_tries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] nvmeof_conn_info_version = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] nvmet_ns_id = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] nvmet_port_id = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] osapi_max_limit = 1000 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] osapi_volume_ext_list = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] osapi_volume_listen_port = 8776 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] osapi_volume_use_ssl = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] osapi_volume_workers = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] per_volume_size_limit = -1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] periodic_fuzzy_delay = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] periodic_interval = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] public_endpoint = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] publish_errors = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] quota_backup_gigabytes = 1000 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] quota_backups = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] quota_gigabytes = 1000 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] quota_groups = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75488]: INFO cinder.volume.manager [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] quota_snapshots = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] quota_volumes = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] rate_limit_burst = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] rate_limit_except_level = CRITICAL {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] rate_limit_interval = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] reinit_driver_count = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] replication_device = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] report_discard_supported = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] report_interval = 120 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] reservation_clean_interval = 86400 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] reservation_expire = 86400 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] reserved_image_namespaces = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] reserved_percentage = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] rpc_response_timeout = 120 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] run_external_periodic_tasks = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] scst_target_driver = iscsi {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] scst_target_iqn_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_down_time = 720 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] shell_completion = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] snapshot_name_template = snapshot-%s {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] snapshot_same_host = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] split_loggers = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] state_path = /opt/stack/data/cinder {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] storage_availability_zone = nova {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] storage_protocol = iSCSI {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] syslog_log_facility = LOG_USER {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] target_helper = lioadm {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] target_ip_address = 192.168.122.208 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] target_port = 3260 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] target_protocol = iscsi {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] target_secondary_ip_addresses = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] trace_flags = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] transport_url = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] until_refresh = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] use_chap_auth = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] use_default_quota_class = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] use_journal = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] use_json = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] use_multipath_for_image_xfer = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] use_stderr = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] use_syslog = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] verify_glance_signatures = enabled {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_api_class = cinder.volume.api.API {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_backend_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_clear = zero {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_clear_ionice = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_clear_size = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_copy_bps_limit = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_dd_blocksize = 1M {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_name_template = volume-%s {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_service_inithost_offload = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volume_usage_audit_period = month {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:27 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] zoning_mode = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_concurrency.disable_process_locking = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.auth_section = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.auth_type = password {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.auth_version = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.cache = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.include_service_catalog = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.insecure = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.interface = public {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_password = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcache_username = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.region_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.service_type = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.backend = dogpile.cache.null {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.backend_argument = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.backend_expiration_time = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.config_prefix = cache.oslo {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.077s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.debug_cache_backend = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.enable_retry_client = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.enable_socket_keepalive = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.expiration_time = 600 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.hashclient_retry_attempts = 2 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.memcache_dead_retry = 300 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.memcache_pool_maxsize = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.memcache_sasl_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.password = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.proxies = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.redis_db = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.redis_server = localhost:6379 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.retry_attempts = 2 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.retry_delay = 0.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.socket_keepalive_count = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.socket_keepalive_idle = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.socket_keepalive_interval = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.socket_timeout = 1.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.tls_allowed_ciphers = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.tls_cafile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.tls_certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.tls_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.tls_keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cache.username = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] coordination.backend_url = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.asyncio_connection = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.asyncio_slave_connection = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.backend = sqlalchemy {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.connection = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.connection_debug = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.connection_parameters = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.connection_recycle_time = 3600 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.connection_trace = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.db_inc_retry_interval = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.db_max_retries = 20 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.db_max_retry_interval = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.db_retry_interval = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.max_overflow = 50 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.max_pool_size = 5 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.max_retries = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.mysql_wsrep_sync_wait = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.pool_timeout = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.retry_interval = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.slave_connection = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.sqlite_synchronous = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.synchronous_reader = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] database.use_db_reconnect = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_tracing.insecure = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.connection_string = messaging:// {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.es_doc_type = notification {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.es_scroll_size = 10000 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.es_scroll_time = 2m {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.filter_error_trace = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.hmac_keys = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.sentinel_service_name = mymaster {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.socket_timeout = 0.1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.trace_requests = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler.trace_sqlalchemy = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler_jaeger.process_tags = {} {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler_jaeger.service_name_prefix = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] profiler_otlp.service_name_prefix = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.enforce_new_defaults = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.policy_default_rule = default {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.policy_file = policy.yaml {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] privsep_osbrick.group = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] privsep_osbrick.helper_command = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack sudo[75492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 09:52:28 devstack sudo[75492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] privsep_osbrick.user = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_sys_admin.group = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_sys_admin.helper_command = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] cinder_sys_admin.user = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.auth_section = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.auth_type = password {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.cafile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.collect_timing = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.insecure = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.send_service_user_token = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.split_loggers = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.timeout = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.tls_ciphers = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] service_user.tls_min_version = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.auth_section = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.auth_type = password {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.collect_timing = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.insecure = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.region_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.split_loggers = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.timeout = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.tls_ciphers = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] glance.tls_min_version = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.backend_availability_zone = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.chap_password = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.chap_username = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.disk_geometry = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.driver_client_cert = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.driver_client_cert_key = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.driver_data_namespace = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.driver_use_ssl = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.extra_capabilities = {} {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.filter_function = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.goodness_function = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.iscsi_target_flags = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.iscsi_write_cache = on {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.iser_helper = tgtadm {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.iser_port = 3260 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.lvm_share_target = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.lvm_type = auto {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.num_shell_tries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.replication_device = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.report_discard_supported = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.reserved_percentage = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.target_helper = tgtadm {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.target_port = 3260 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.target_protocol = iscsi {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.trace_flags = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.unique_fqdn_network = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.use_chap_auth = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_backend_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_clear = zero {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_clear_ionice = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_clear_size = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_reports.file_event_handler = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_reports.log_dir = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.backend_host = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.chap_password = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.chap_username = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.disk_geometry = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.driver_client_cert = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.extra_capabilities = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.filter_function = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.goodness_function = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.iser_helper = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.iser_ip_address = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.iser_port = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.lvm_share_target = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.lvm_type = auto {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.num_shell_tries = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.replication_device = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.report_discard_supported = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.reserved_percentage = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.scst_target_driver = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.storage_protocol = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.target_helper = lioadm {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.target_ip_address = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.target_port = 3260 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.trace_flags = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.use_chap_auth = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_clear = zero {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_clear_size = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] lvmdriver-1.volumes_dir = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.ssl = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_notifications.driver = [] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_notifications.retry = -1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] key_manager.fixed_key = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.barbican_api_version = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.barbican_endpoint = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.barbican_endpoint_type = public {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.barbican_region_name = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.cafile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.collect_timing = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.insecure = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.number_of_retries = 60 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.retry_delay = 1 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.send_service_user_token = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.split_loggers = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.timeout = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.tls_ciphers = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.tls_min_version = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.verify_ssl = True {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican.verify_ssl_path = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.auth_section = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.auth_type = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.cafile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.certfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.collect_timing = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.insecure = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.keyfile = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.split_loggers = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.timeout = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.tls_ciphers = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] barbican_service_user.tls_min_version = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.approle_role_id = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.approle_secret_id = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.auth_method = approle {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.auth_path = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.kv_mountpoint = secret {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.kv_path = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.kv_version = 2 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.namespace = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.root_token_id = **** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.ssl_ca_crt_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.timeout = 60.0 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.token_file = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.token_role = None {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.use_ssl = False {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:28 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] ******************************************************************************** {{(pid=75338) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:52:28 devstack sudo[75492]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack sudo[75563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:28 devstack sudo[75563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:28 devstack sudo[75563]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.281s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:52:28 devstack cinder-volume[75488]: INFO cinder.brick.local_dev.lvm [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack sudo[75691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:28 devstack sudo[75691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[75691]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:29 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[75488]: DEBUG cinder.brick.local_dev.lvm [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75488) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 09:52:29 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[75798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:29 devstack sudo[75798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[75798]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:29 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.525s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[75984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:29 devstack sudo[75984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[75984]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.355s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[76103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 09:52:30 devstack sudo[76103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[76103]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.290s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[76106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:30 devstack sudo[76106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[76106]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[76190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:30 devstack sudo[76190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:31 devstack sudo[76190]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[76199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:31 devstack sudo[76199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:31 devstack sudo[76199]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[76282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:31 devstack sudo[76282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:31 devstack sudo[76282]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[76286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:31 devstack sudo[76286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[76286]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[75488]: INFO cinder.volume.drivers.lvm [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack sudo[76290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:32 devstack sudo[76290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[76290]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG cinder.volume.drivers.lvm [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Updating volume stats {{(pid=75488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack sudo[76293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:32 devstack sudo[76293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[76293]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack sudo[76303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:32 devstack sudo[76303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[76303]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack sudo[76306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:32 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:33 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:33 devstack sudo[76309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:33 devstack sudo[76309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:33 devstack sudo[76309]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:33 devstack cinder-volume[75488]: INFO cinder.volume.driver [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG cinder.volume.driver [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75488) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG oslo_db.sqlalchemy.engines [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG dbcounter [-] [75488] Writer thread running {{(pid=75488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG cinder.db.api [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Building query based on filter {{(pid=75488) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG cinder.image.image_utils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75488) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:52:33 devstack cinder-volume[75488]: INFO cinder.keymgr.migration [None req-1ec7a3d8-835f-4dd5-af86-0e46744cee74 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG cinder.volume.drivers.lvm [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Updating volume stats {{(pid=75488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:33 devstack sudo[76313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:33 devstack sudo[76313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:33 devstack sudo[76313]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:33 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:33 devstack sudo[76317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:33 devstack sudo[76317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:34 devstack sudo[76317]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:34 devstack sudo[76321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:34 devstack sudo[76321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:34 devstack sudo[76321]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:34 devstack sudo[76324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:34 devstack sudo[76324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:34 devstack sudo[76324]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG cinder.manager [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Notifying Schedulers of capabilities ... {{(pid=75488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:34 devstack cinder-volume[75488]: INFO cinder.volume.manager [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Driver initialization completed successfully. Nov 02 09:52:34 devstack cinder-volume[75488]: INFO cinder.manager [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Initiating service 2 cleanup Nov 02 09:52:34 devstack cinder-volume[75488]: INFO cinder.manager [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Service 2 cleanup completed. Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG cinder.service [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Creating RPC server for service cinder-volume {{(pid=75488) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG cinder.service [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75488) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:52:34 devstack cinder-volume[75488]: INFO cinder.volume.manager [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 09:52:34 devstack cinder-volume[75488]: DEBUG cinder.volume.drivers.lvm [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Updating volume stats {{(pid=75488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:52:35 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:35 devstack sudo[76328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:35 devstack sudo[76328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:35 devstack sudo[76328]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:35 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:35 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:35 devstack sudo[76333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:35 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:35 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:35 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:35 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:35 devstack sudo[76336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:35 devstack sudo[76336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:35 devstack sudo[76336]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:35 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:35 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:35 devstack sudo[76339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:35 devstack sudo[76339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:36 devstack sudo[76339]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:36 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:36 devstack cinder-volume[75488]: INFO cinder.volume.manager [None req-5476e78f-93bf-4be4-9f8e-1a5f86e74daf None None] Driver post RPC initialization completed successfully. Nov 02 09:52:37 devstack cinder-volume[75338]: DEBUG dbcounter [-] [75338] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75338) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:52:46 devstack cinder-volume[75488]: DEBUG dbcounter [-] [75488] Writing DB stats cinder:SELECT=3 {{(pid=75488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:52:46 devstack cinder-volume[75488]: DEBUG dbcounter [-] [75488] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:53:14 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager._thread_info {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:53:14 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread count: 6 {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:53:14 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread info: [<_MainThread(MainThread, started 125150659936384)>, , , , , ] {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:54:14 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:54:14 devstack cinder-volume[75488]: DEBUG cinder.volume.drivers.lvm [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Updating volume stats {{(pid=75488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:54:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:14 devstack sudo[81456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:54:14 devstack sudo[81456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:14 devstack sudo[81456]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:14 devstack sudo[81459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:54:14 devstack sudo[81459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:14 devstack sudo[81459]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:14 devstack sudo[81462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:54:14 devstack sudo[81462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:15 devstack sudo[81462]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:15 devstack sudo[81465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:54:15 devstack sudo[81465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:15 devstack sudo[81465]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:15 devstack cinder-volume[75488]: DEBUG cinder.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Notifying Schedulers of capabilities ... {{(pid=75488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:54:15 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager._thread_info {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:54:15 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread count: 6 {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:54:15 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread info: [<_MainThread(MainThread, started 125150659936384)>, , , , , ] {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:54:46 devstack cinder-volume[75488]: DEBUG dbcounter [-] [75488] Writing DB stats cinder:SELECT=1 {{(pid=75488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:54:46 devstack cinder-volume[75488]: DEBUG dbcounter [-] [75488] Writing DB stats cinder:UPDATE=1 {{(pid=75488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:55:14 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:55:14 devstack cinder-volume[75488]: DEBUG cinder.volume.drivers.lvm [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Updating volume stats {{(pid=75488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:55:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:14 devstack sudo[83256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:14 devstack sudo[83256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:14 devstack sudo[83256]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:14 devstack sudo[83283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:14 devstack sudo[83283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:14 devstack sudo[83283]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:14 devstack sudo[83310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:14 devstack sudo[83310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:15 devstack sudo[83310]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:15 devstack sudo[83342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:15 devstack sudo[83342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:15 devstack sudo[83342]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:15 devstack cinder-volume[75488]: DEBUG cinder.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Notifying Schedulers of capabilities ... {{(pid=75488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:55:15 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager._thread_info {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:55:15 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread count: 6 {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:55:15 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread info: [<_MainThread(MainThread, started 125150659936384)>, , , , , ] {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:56:14 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:56:14 devstack cinder-volume[75488]: DEBUG cinder.volume.drivers.lvm [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Updating volume stats {{(pid=75488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:56:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:14 devstack sudo[84779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:56:14 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:14 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:14 devstack sudo[84782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:56:14 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:14 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:14 devstack sudo[84800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:56:14 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:15 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:15 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:56:15 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:15 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:15 devstack cinder-volume[75488]: DEBUG cinder.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Notifying Schedulers of capabilities ... {{(pid=75488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:46 devstack cinder-volume[75488]: DEBUG dbcounter [-] [75488] Writing DB stats cinder:SELECT=1 {{(pid=75488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:56:46 devstack cinder-volume[75488]: DEBUG dbcounter [-] [75488] Writing DB stats cinder:UPDATE=1 {{(pid=75488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:14 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:57:14 devstack cinder-volume[75488]: DEBUG cinder.volume.drivers.lvm [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Updating volume stats {{(pid=75488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:57:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:14 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:57:14 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:14 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:14 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:57:14 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:14 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:14 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:14 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:57:14 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:15 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.320s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:15 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:57:15 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:15 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:15 devstack cinder-volume[75488]: DEBUG oslo_concurrency.processutils [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:15 devstack cinder-volume[75488]: DEBUG cinder.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Notifying Schedulers of capabilities ... {{(pid=75488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:15 devstack cinder-volume[75488]: DEBUG oslo_service.periodic_task [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] Running periodic task VolumeManager._thread_info {{(pid=75488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:57:15 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread count: 6 {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:57:15 devstack cinder-volume[75488]: DEBUG cinder.volume.manager [None req-89517acb-8e1a-44fb-884a-2e6c2eb8ba4d None None] thread info: [<_MainThread(MainThread, started 125150659936384)>, , , , , ] {{(pid=75488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:57:15 devstack cinder-volume[75338]: INFO oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Caught SIGTERM, stopping children Nov 02 09:57:15 devstack cinder-volume[75338]: DEBUG oslo_concurrency.lockutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Acquiring lock "singleton_lock" {{(pid=75338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:15 devstack cinder-volume[75338]: DEBUG oslo_concurrency.lockutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Acquired lock "singleton_lock" {{(pid=75338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:15 devstack cinder-volume[75338]: DEBUG oslo_concurrency.lockutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Releasing lock "singleton_lock" {{(pid=75338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:15 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Stop services. {{(pid=75338) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 09:57:15 devstack cinder-volume[75338]: DEBUG oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Killing children. {{(pid=75338) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 09:57:15 devstack cinder-volume[75338]: INFO oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Waiting on 1 children to exit Nov 02 09:57:19 devstack cinder-volume[75488]: DEBUG oslo_concurrency.lockutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Acquiring lock "singleton_lock" {{(pid=75488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:19 devstack cinder-volume[75488]: DEBUG oslo_concurrency.lockutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Acquired lock "singleton_lock" {{(pid=75488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:19 devstack cinder-volume[75488]: DEBUG oslo_concurrency.lockutils [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Releasing lock "singleton_lock" {{(pid=75488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:19 devstack cinder-volume[75488]: WARNING amqp [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:19 devstack cinder-volume[75488]: WARNING amqp [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:20 devstack cinder-volume[75338]: INFO oslo_service.backend._eventlet.service [None req-1ec2a85c-0724-4a70-848f-c7b3b144a565 None None] Child 75488 exited with status 0 Nov 02 09:57:20 devstack cinder-volume[86122]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:57:20 devstack cinder-volume[86122]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:57:20 devstack cinder-volume[86122]: we strongly recommend against using it for new projects. Nov 02 09:57:20 devstack cinder-volume[86122]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:57:20 devstack cinder-volume[86122]: framework. For more detail see Nov 02 09:57:20 devstack cinder-volume[86122]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:57:20 devstack cinder-volume[86122]: import eventlet # noqa Nov 02 09:57:22 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:22 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:22 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:23 devstack cinder-volume[86122]: INFO dbcounter [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Registered counter for database cinder Nov 02 09:57:23 devstack cinder-volume[86122]: DEBUG oslo_db.sqlalchemy.engines [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:23 devstack cinder-volume[86122]: DEBUG dbcounter [-] [86122] Writer thread running {{(pid=86122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:23 devstack cinder-volume[86122]: INFO cinder.rpc [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:57:23 devstack cinder-volume[86122]: INFO cinder.rpc [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_db.sqlalchemy.engines [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:24 devstack cinder-volume[86122]: INFO cinder.volume.manager [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Determined volume DB was empty at startup. Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG cinder.volume.manager [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86122) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:57:24 devstack cinder-volume[86122]: INFO cinder.volume.manager [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 09:57:24 devstack cinder-volume[86122]: WARNING stevedore.named [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:57:24 devstack cinder-volume[86122]: WARNING castellan.key_manager [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:24 devstack cinder-volume[86122]: WARNING cinder.keymgr.conf_key_mgr [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:24 devstack cinder-volume[86122]: INFO cinder.volume.manager [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_db.sqlalchemy.engines [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:24 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Starting 1 workers Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Started child 86396 {{(pid=86122) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Full set of CONF: {{(pid=86122) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] ******************************************************************************** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Configuration options gathered from: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] ================================================================================ {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] allow_availability_zone_fallback = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] allow_compression_on_image_upload = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] allowed_direct_url_schemes = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] api_rate_limit = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] auth_strategy = keystone {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_host = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_stats_polling_interval = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backup_api_class = cinder.backup.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backup_name_template = backup-%s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backup_use_same_host = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backup_use_temp_snapshot = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] chap_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] chap_username = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_internal_tenant_project_id = e23b987467c34404aade729d806e7bf0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_internal_tenant_user_id = 30048208c6fb456b80ffe7ae6b7a2877 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cluster = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] compression_format = gzip {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] compute_api_class = cinder.compute.nova.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] config_dir = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] config_source = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] control_exchange = openstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] debug = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] default_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] default_group_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86396]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] default_volume_type = QuobyteHD {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] disk_geometry = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] driver_client_cert = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] driver_client_cert_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] driver_data_namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] driver_ssl_cert_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] driver_ssl_cert_verify = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] driver_use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] enable_new_services = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] enable_unsupported_driver = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] enabled_backends = ['QuobyteHD'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] enforce_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] filter_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_api_insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_api_ssl_compression = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_ca_certificates_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_catalog_info = image:glance:publicURL {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_num_retries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance_request_timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] goodness_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] graceful_shutdown_timeout = 5 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] group_api_class = cinder.group.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] host = devstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_compress_on_upload = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_conversion_address_space_limit = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_conversion_cpu_limit = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_conversion_disable = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_introspection_address_space_limit = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_introspection_cpu_limit = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_upload_use_cinder_backend = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_upload_use_internal_tenant = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_volume_cache_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_volume_cache_max_count = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] image_volume_cache_max_size_gb = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] init_host_max_objects_retrieval = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] instance_format = [instance: %(uuid)s] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] iscsi_target_flags = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] iscsi_write_cache = on {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] iser_helper = tgtadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] iser_ip_address = 192.168.122.208 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] iser_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_color = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_config_append = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_dir = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_options = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_rotate_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_rotate_interval_type = days {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] log_rotation_type = none {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] max_age = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] max_logfile_count = 30 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] max_logfile_size_mb = 200 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] max_over_subscription_ratio = 20.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] message_reap_interval = 86400 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] message_ttl = 2592000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] migration_create_volume_timeout_secs = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] monkey_patch = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] monkey_patch_modules = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] my_ip = 192.168.122.208 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] no_snapshot_gb_quota = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] num_iser_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] num_shell_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] num_volume_device_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] nvmeof_conn_info_version = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] nvmet_ns_id = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] nvmet_port_id = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] osapi_max_limit = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] osapi_volume_ext_list = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] osapi_volume_listen_port = 8776 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] osapi_volume_use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] osapi_volume_workers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] per_volume_size_limit = -1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] periodic_fuzzy_delay = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] periodic_interval = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] public_endpoint = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] publish_errors = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] quota_backup_gigabytes = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] quota_backups = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] quota_gigabytes = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] quota_groups = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] quota_snapshots = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] quota_volumes = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] rate_limit_burst = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] rate_limit_except_level = CRITICAL {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] rate_limit_interval = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] reinit_driver_count = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] replication_device = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] report_discard_supported = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] report_interval = 120 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] reservation_clean_interval = 86400 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] reservation_expire = 86400 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.remotefs [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86396) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] reserved_image_namespaces = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] reserved_percentage = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] rpc_response_timeout = 120 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] run_external_periodic_tasks = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] scst_target_driver = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] scst_target_iqn_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_down_time = 720 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] shell_completion = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] snapshot_name_template = snapshot-%s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] state_path = /opt/stack/data/cinder {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] storage_availability_zone = nova {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] storage_protocol = iSCSI {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] syslog_log_facility = LOG_USER {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] target_helper = lioadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] target_ip_address = 192.168.122.208 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] target_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] target_protocol = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] target_secondary_ip_addresses = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] trace_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] transport_url = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] until_refresh = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] use_chap_auth = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] use_default_quota_class = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] use_journal = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] use_json = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] use_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] use_stderr = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] use_syslog = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] verify_glance_signatures = enabled {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_api_class = cinder.volume.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_backend_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_clear = zero {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_clear_ionice = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_clear_size = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_copy_bps_limit = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_dd_blocksize = 1M {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_name_template = volume-%s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_service_inithost_offload = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volume_usage_audit_period = month {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] zoning_mode = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_concurrency.disable_process_locking = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.auth_type = password {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.auth_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.cache = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.include_service_catalog = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.interface = public {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcache_username = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.region_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.service_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.backend = dogpile.cache.null {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.backend_argument = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.backend_expiration_time = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.config_prefix = cache.oslo {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.debug_cache_backend = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.enable_retry_client = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.enable_socket_keepalive = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.expiration_time = 600 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.hashclient_retry_attempts = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.memcache_dead_retry = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.memcache_pool_maxsize = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.memcache_sasl_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.proxies = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.redis_db = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.redis_server = localhost:6379 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.retry_attempts = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.retry_delay = 0.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.socket_keepalive_count = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.socket_keepalive_idle = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.socket_keepalive_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.socket_timeout = 1.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.tls_allowed_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.tls_cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.tls_certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.tls_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.tls_keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cache.username = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] coordination.backend_url = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.asyncio_connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.asyncio_slave_connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.backend = sqlalchemy {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.connection_debug = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.connection_parameters = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.connection_recycle_time = 3600 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.connection_trace = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.db_inc_retry_interval = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.db_max_retries = 20 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.db_max_retry_interval = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.db_retry_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.max_overflow = 50 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.max_pool_size = 5 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.max_retries = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.mysql_wsrep_sync_wait = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.pool_timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.retry_interval = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.slave_connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.sqlite_synchronous = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.synchronous_reader = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] database.use_db_reconnect = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_tracing.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.connection_string = messaging:// {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.es_doc_type = notification {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.es_scroll_size = 10000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.es_scroll_time = 2m {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.filter_error_trace = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.hmac_keys = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.sentinel_service_name = mymaster {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.socket_timeout = 0.1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.trace_requests = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler.trace_sqlalchemy = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler_jaeger.process_tags = {} {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler_jaeger.service_name_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] profiler_otlp.service_name_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.enforce_new_defaults = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.policy_default_rule = default {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.policy_file = policy.yaml {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] privsep_osbrick.group = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] privsep_osbrick.helper_command = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] privsep_osbrick.user = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_sys_admin.group = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_sys_admin.helper_command = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] cinder_sys_admin.user = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.auth_type = password {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.send_service_user_token = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] service_user.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.auth_type = password {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.region_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] glance.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.backend_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.chap_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.chap_username = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.disk_geometry = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.driver_client_cert = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.driver_client_cert_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.driver_data_namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.driver_use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.extra_capabilities = {} {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.filter_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.goodness_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.iscsi_target_flags = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.iscsi_write_cache = on {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.iser_helper = tgtadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.iser_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_host = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_login = admin {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_mount_options = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_private_key = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_share_path = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.num_shell_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.quobyte_volume_url = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.replication_device = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.report_discard_supported = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.reserved_percentage = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.target_helper = tgtadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.target_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.target_protocol = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.trace_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.unique_fqdn_network = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.use_chap_auth = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_backend_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_clear = zero {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_clear_ionice = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_clear_size = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_reports.file_event_handler = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_reports.log_dir = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.backend_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.backend_host = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.chap_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.chap_username = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.chiscsi_conf = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.disk_geometry = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.driver_client_cert = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.driver_data_namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.driver_use_ssl = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.extra_capabilities = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.filter_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.goodness_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.iser_helper = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.iser_ip_address = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.iser_port = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.iser_target_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_host = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_login = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86396) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_mount_options = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_private_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_share_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_ssh_port = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.num_shell_tries = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.nvmet_port_id = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86396]: WARNING cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86396]: WARNING cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.replication_device = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.report_discard_supported = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.reserved_percentage = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.scst_target_driver = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.storage_protocol = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.target_helper = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.target_ip_address = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.target_port = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.target_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.target_protocol = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.trace_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Running cmd (subprocess): mount.quobyte {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.use_chap_auth = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_clear = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_clear_size = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] QuobyteHD.volumes_dir = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_notifications.driver = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_notifications.retry = -1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] key_manager.fixed_key = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.barbican_api_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.barbican_endpoint = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.barbican_endpoint_type = public {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.barbican_region_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.number_of_retries = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.retry_delay = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.send_service_user_token = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.verify_ssl = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican.verify_ssl_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.auth_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] barbican_service_user.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.approle_role_id = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.approle_secret_id = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.auth_method = approle {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.auth_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.kv_mountpoint = secret {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.kv_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.kv_version = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.root_token_id = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.ssl_ca_crt_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.timeout = 60.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.token_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.token_role = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:24 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] ******************************************************************************** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:57:24 devstack quobyte-client[86409]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 09:57:24 devstack quobyte-client[86409]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:24 devstack cinder-volume[86396]: INFO cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 ... Nov 02 09:57:24 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 -c /etc/quobyte/client-cinder.cfg {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:24 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 -c /etc/quobyte/client-cinder.cfg Nov 02 09:57:24 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.475s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86396]: INFO cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 succeeded Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.488s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:25 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:57:25 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.248s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86396]: INFO cinder.volume.driver [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.volume.driver [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.816318511963, 'free_capacity_gb': 1773.816318511963, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86396) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_db.sqlalchemy.engines [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86396) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writer thread running {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.db.api [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Building query based on filter {{(pid=86396) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.image.image_utils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86396) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:57:25 devstack cinder-volume[86396]: INFO cinder.keymgr.migration [None req-8d72388c-18f8-433a-915e-f4e716196962 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:25 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:57:25 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.261s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:25 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Driver initialization completed successfully. Nov 02 09:57:25 devstack cinder-volume[86396]: INFO cinder.manager [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Initiating service 3 cleanup Nov 02 09:57:25 devstack cinder-volume[86396]: INFO cinder.manager [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Service 3 cleanup completed. Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.service [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Creating RPC server for service cinder-volume {{(pid=86396) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:57:25 devstack cinder-volume[86396]: DEBUG cinder.service [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86396) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:57:26 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 09:57:26 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:26 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:26 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:26 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:26 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:26 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:26 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:57:26 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:26 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:26 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.285s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:26 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-fb925c13-d749-4f41-b81b-7686dbfd11bd None None] Driver post RPC initialization completed successfully. Nov 02 09:57:30 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:30 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:30 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:30 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:30 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:30 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:30 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:57:30 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:31 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:31 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.237s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:31 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-ccf3775b-dc13-4347-bde0-34671c8aaec0 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:34 devstack cinder-volume[86122]: DEBUG dbcounter [-] [86122] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:34 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Caught SIGTERM, stopping children Nov 02 09:57:34 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Acquiring lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:34 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Acquired lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:34 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Releasing lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:34 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Stop services. {{(pid=86122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 09:57:34 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Killing children. {{(pid=86122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 09:57:34 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Waiting on 1 children to exit Nov 02 09:57:36 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:36 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:39 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Acquiring lock "singleton_lock" {{(pid=86396) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:39 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Acquired lock "singleton_lock" {{(pid=86396) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:39 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Releasing lock "singleton_lock" {{(pid=86396) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:39 devstack cinder-volume[86396]: WARNING amqp [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:39 devstack cinder-volume[86396]: WARNING amqp [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:39 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-7c72c595-7367-4762-a681-f13ed480ac9d None None] Child 86396 exited with status 0 Nov 02 09:57:40 devstack cinder-volume[86744]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:57:40 devstack cinder-volume[86744]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:57:40 devstack cinder-volume[86744]: we strongly recommend against using it for new projects. Nov 02 09:57:40 devstack cinder-volume[86744]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:57:40 devstack cinder-volume[86744]: framework. For more detail see Nov 02 09:57:40 devstack cinder-volume[86744]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:57:40 devstack cinder-volume[86744]: import eventlet # noqa Nov 02 09:57:43 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:43 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:43 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:43 devstack cinder-volume[86744]: INFO dbcounter [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Registered counter for database cinder Nov 02 09:57:43 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writer thread running {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:44 devstack cinder-volume[86744]: INFO cinder.rpc [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:57:44 devstack cinder-volume[86744]: INFO cinder.rpc [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:44 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Determined volume DB was empty at startup. Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG cinder.volume.manager [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86744) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:57:44 devstack cinder-volume[86744]: WARNING stevedore.named [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:57:44 devstack cinder-volume[86744]: WARNING castellan.key_manager [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:44 devstack cinder-volume[86744]: WARNING cinder.keymgr.conf_key_mgr [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:44 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:44 devstack cinder-volume[86744]: INFO oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Starting 1 workers Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Started child 87005 {{(pid=86744) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Full set of CONF: {{(pid=86744) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] ******************************************************************************** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] Configuration options gathered from: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] ================================================================================ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] allow_availability_zone_fallback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[87005]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] allow_compression_on_image_upload = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] allowed_direct_url_schemes = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] api_rate_limit = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] auth_strategy = keystone {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_stats_polling_interval = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backup_api_class = cinder.backup.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backup_name_template = backup-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backup_use_same_host = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backup_use_temp_snapshot = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] chap_username = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_internal_tenant_project_id = e23b987467c34404aade729d806e7bf0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_internal_tenant_user_id = 30048208c6fb456b80ffe7ae6b7a2877 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cluster = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] compression_format = gzip {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] config_dir = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] config_source = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] control_exchange = openstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] debug = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] default_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] default_group_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] default_volume_type = QuobyteHD {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] driver_ssl_cert_verify = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] driver_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] enable_new_services = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] enable_unsupported_driver = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] enforce_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_api_insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_api_ssl_compression = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_ca_certificates_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_num_retries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance_request_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] graceful_shutdown_timeout = 5 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] group_api_class = cinder.group.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] host = devstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_compress_on_upload = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_conversion_address_space_limit = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_conversion_cpu_limit = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_conversion_disable = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_introspection_address_space_limit = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_introspection_cpu_limit = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_upload_use_cinder_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_upload_use_internal_tenant = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_volume_cache_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_volume_cache_max_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] init_host_max_objects_retrieval = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] instance_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] iscsi_target_flags = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] iscsi_write_cache = on {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] iser_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] iser_ip_address = 192.168.122.208 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] iser_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_color = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_config_append = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_options = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_rotate_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_rotate_interval_type = days {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] log_rotation_type = none {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] max_age = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] max_logfile_count = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] max_logfile_size_mb = 200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] max_over_subscription_ratio = 20.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] message_reap_interval = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] message_ttl = 2592000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] monkey_patch = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] monkey_patch_modules = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] my_ip = 192.168.122.208 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] no_snapshot_gb_quota = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] num_iser_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87005) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] num_shell_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] num_volume_device_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] nvmeof_conn_info_version = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] nvmet_ns_id = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] nvmet_port_id = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] osapi_max_limit = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] osapi_volume_ext_list = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] osapi_volume_listen_port = 8776 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] osapi_volume_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] osapi_volume_workers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] per_volume_size_limit = -1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] periodic_fuzzy_delay = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] periodic_interval = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] public_endpoint = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] publish_errors = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] quota_backup_gigabytes = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] quota_backups = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] quota_gigabytes = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] quota_groups = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] quota_snapshots = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] quota_volumes = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] rate_limit_burst = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] rate_limit_except_level = CRITICAL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] rate_limit_interval = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] reinit_driver_count = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] report_discard_supported = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] report_interval = 120 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] reservation_clean_interval = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] reservation_expire = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] reserved_image_namespaces = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] reserved_percentage = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] rpc_response_timeout = 120 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] run_external_periodic_tasks = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] scst_target_driver = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_down_time = 720 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] shell_completion = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] snapshot_name_template = snapshot-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] state_path = /opt/stack/data/cinder {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] storage_availability_zone = nova {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] storage_protocol = iSCSI {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] syslog_log_facility = LOG_USER {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] target_helper = lioadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] target_ip_address = 192.168.122.208 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] target_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] target_protocol = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] target_secondary_ip_addresses = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] transport_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] until_refresh = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] use_chap_auth = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] use_default_quota_class = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] use_journal = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] use_json = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] use_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] use_stderr = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] use_syslog = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] verify_glance_signatures = enabled {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_api_class = cinder.volume.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_clear = zero {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_clear_size = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_copy_bps_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_dd_blocksize = 1M {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_name_template = volume-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_service_inithost_offload = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volume_usage_audit_period = month {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] zoning_mode = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.auth_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.interface = public {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcache_username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.service_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.backend = dogpile.cache.null {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.backend_argument = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.backend_expiration_time = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.config_prefix = cache.oslo {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.debug_cache_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.enable_retry_client = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.enable_socket_keepalive = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.expiration_time = 600 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.memcache_dead_retry = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.memcache_sasl_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.proxies = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.redis_db = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.redis_server = localhost:6379 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.retry_attempts = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.retry_delay = 0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.socket_keepalive_count = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.socket_keepalive_idle = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.socket_keepalive_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.socket_timeout = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.tls_allowed_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.tls_cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.tls_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.tls_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.tls_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cache.username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] coordination.backend_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.asyncio_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.asyncio_slave_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.backend = sqlalchemy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.connection_debug = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.connection_parameters = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.connection_recycle_time = 3600 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.connection_trace = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.db_inc_retry_interval = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.db_max_retries = 20 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.db_max_retry_interval = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.db_retry_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87005) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.max_overflow = 50 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.max_pool_size = 5 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.max_retries = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.pool_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.retry_interval = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.slave_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.sqlite_synchronous = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.synchronous_reader = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] database.use_db_reconnect = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_tracing.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.connection_string = messaging:// {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.es_doc_type = notification {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.es_scroll_size = 10000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.es_scroll_time = 2m {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.filter_error_trace = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.hmac_keys = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.sentinel_service_name = mymaster {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.socket_timeout = 0.1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.trace_requests = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler.trace_sqlalchemy = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler_jaeger.process_tags = {} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] profiler_otlp.service_name_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.policy_default_rule = default {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] privsep_osbrick.group = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] privsep_osbrick.helper_command = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] privsep_osbrick.user = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_sys_admin.group = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_sys_admin.helper_command = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] cinder_sys_admin.user = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.send_service_user_token = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] service_user.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] glance.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.chap_username = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.driver_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.extra_capabilities = {} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.iscsi_target_flags = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.iser_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_host = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_login = admin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_mount_options = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_private_key = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_share_path = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.report_discard_supported = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.target_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.target_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.target_protocol = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.use_chap_auth = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_clear = zero {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_reports.file_event_handler = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_reports.log_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.backend_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.chap_username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack quobyte-client[87006]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 09:57:44 devstack quobyte-client[87006]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.extra_capabilities = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.iser_helper = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.iser_ip_address = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.iser_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_login = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_mount_options = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_private_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_share_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.num_shell_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.report_discard_supported = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.reserved_percentage = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.scst_target_driver = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.storage_protocol = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.target_helper = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.target_ip_address = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.target_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.target_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.target_protocol = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.use_chap_auth = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_clear = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_clear_size = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] QuobyteHD.volumes_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_notifications.driver = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] key_manager.fixed_key = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.barbican_api_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.barbican_endpoint = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.barbican_endpoint_type = public {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.barbican_region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.number_of_retries = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.retry_delay = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.send_service_user_token = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.verify_ssl = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican.verify_ssl_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.auth_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] barbican_service_user.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.approle_role_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.approle_secret_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.auth_method = approle {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.auth_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.kv_mountpoint = secret {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.kv_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.kv_version = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.root_token_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.ssl_ca_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.token_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.token_role = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:44 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-405ce9b0-bd29-4495-b9ba-fa8b4f9fb8c8 None None] ******************************************************************************** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:57:44 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.253s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:44 devstack cinder-volume[87005]: INFO cinder.volume.driver [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:57:44 devstack cinder-volume[87005]: DEBUG cinder.volume.driver [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87005) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_db.sqlalchemy.engines [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writer thread running {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.db.api [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Building query based on filter {{(pid=87005) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87005) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:45 devstack cinder-volume[87005]: INFO cinder.keymgr.migration [None req-17e2de59-8ef7-43df-ac6f-b2d655165549 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:57:45 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:57:45 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:45 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.261s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Driver initialization completed successfully. Nov 02 09:57:45 devstack cinder-volume[87005]: INFO cinder.manager [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Initiating service 3 cleanup Nov 02 09:57:45 devstack cinder-volume[87005]: INFO cinder.manager [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Service 3 cleanup completed. Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.service [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Creating RPC server for service cinder-volume {{(pid=87005) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.service [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87005) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:57:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:45 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:57:45 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:45 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.237s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-68a5680c-1014-49c2-8e23-8137746ccdf2 None None] Driver post RPC initialization completed successfully. Nov 02 09:57:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:57:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 6 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:57:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:57:54 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:55 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:55 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Flow 'volume_create_manager' (51861594-6019-41c5-8623-4676c3bcd012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219fa7b2-4e82-440a-a179-624e84cb72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219fa7b2-4e82-440a-a179-624e84cb72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-724708619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326bff20-8bf2-40c3-a3cb-3f11a5e765c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e6a7ca29814778bff0c7d1065c3f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:44Z,use_quota=True,user_id='b9d6a48b7d30471096659d6daf595341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40b1beb-e1ed-4720-8fd3-8581b78d6390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40b1beb-e1ed-4720-8fd3-8581b78d6390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa7bf2-3ad8-49af-abd5-e2fcd5bd45e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa7bf2-3ad8-49af-abd5-e2fcd5bd45e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326bff20-8bf2-40c3-a3cb-3f11a5e765c0', 'volume_name': 'volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa056ab-8302-4ff8-896d-d93894eaf5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa056ab-8302-4ff8-896d-d93894eaf5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cea287-310b-4e6c-ad06-13ab8a3e3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Volume 326bff20-8bf2-40c3-a3cb-3f11a5e765c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0', 'volume_size': 1} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-724708619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326bff20-8bf2-40c3-a3cb-3f11a5e765c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e6a7ca29814778bff0c7d1065c3f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:44Z,use_quota=True,user_id='b9d6a48b7d30471096659d6daf595341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Creating volume 326bff20-8bf2-40c3-a3cb-3f11a5e765c0 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:44 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:44 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 1073741824 Nov 02 09:58:44 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Flow 'volume_create_manager' (8625729b-a66f-402f-94a4-a2bb50ed7bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22180f07-fc4a-41a3-839f-ec539551bd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Flow 'volume_create_manager' (15205b60-1e73-4119-bbac-daa14e8abc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1e4959-b120-44b0-a2fd-f19d78976d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1e4959-b120-44b0-a2fd-f19d78976d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1837413172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865516af-686d-4a41-bcea-7d3037a367b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c7fc19c2054e4aac2307e4068c9bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:44Z,use_quota=True,user_id='bb3587d53f704dabb5f2ccb8699d6b49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228bcf6-deea-47ff-8606-4cb4787c35c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228bcf6-deea-47ff-8606-4cb4787c35c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bf482b-aae7-41a3-84bf-852411aaeae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bf482b-aae7-41a3-84bf-852411aaeae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865516af-686d-4a41-bcea-7d3037a367b4', 'volume_name': 'volume-865516af-686d-4a41-bcea-7d3037a367b4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7797ca57-5c93-494f-bc29-d60a20e7c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7797ca57-5c93-494f-bc29-d60a20e7c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12778367-ae8c-4b05-9dd4-3461070d4e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Volume 865516af-686d-4a41-bcea-7d3037a367b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865516af-686d-4a41-bcea-7d3037a367b4', 'volume_size': 1} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22180f07-fc4a-41a3-839f-ec539551bd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-219996228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d72543-add2-4bc3-a26b-9bc25ca9318c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1865fa89747746da8a727b06049783c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:44Z,use_quota=True,user_id='1ea8771401e6483e8fc96bfe308b2dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a4e393-8e7b-4d12-a5fc-be19d6a0de39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a4e393-8e7b-4d12-a5fc-be19d6a0de39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3002e71-1638-4d93-a743-f43dea73e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3002e71-1638-4d93-a743-f43dea73e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d72543-add2-4bc3-a26b-9bc25ca9318c', 'volume_name': 'volume-45d72543-add2-4bc3-a26b-9bc25ca9318c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c65d9e-1a5b-46d0-b8c2-0c22c4a5aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c65d9e-1a5b-46d0-b8c2-0c22c4a5aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2799b7db-f285-43e4-b631-dc14bffde604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Volume 45d72543-add2-4bc3-a26b-9bc25ca9318c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d72543-add2-4bc3-a26b-9bc25ca9318c', 'volume_size': 1} Nov 02 09:58:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:45 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 1073741824" returned: 0 in 0.721s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:45 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 Nov 02 09:58:45 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:45 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0" returned: 0 in 0.286s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1837413172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865516af-686d-4a41-bcea-7d3037a367b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c7fc19c2054e4aac2307e4068c9bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:44Z,use_quota=True,user_id='bb3587d53f704dabb5f2ccb8699d6b49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Creating volume 865516af-686d-4a41-bcea-7d3037a367b4 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:45 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cea287-310b-4e6c-ad06-13ab8a3e3590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 1073741824 Nov 02 09:58:45 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf027e81-0216-497d-952e-f01c8fdc72fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Volume volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 (326bff20-8bf2-40c3-a3cb-3f11a5e765c0): created successfully Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf027e81-0216-497d-952e-f01c8fdc72fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Flow 'volume_create_manager' (51861594-6019-41c5-8623-4676c3bcd012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a5df7e65-074c-4982-bc89-a9838ba6b7ea tempest-TaggedAttachmentsTest-365475200 None] Created volume successfully. Nov 02 09:58:46 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 1073741824" returned: 0 in 0.685s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:46 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 Nov 02 09:58:46 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:46 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4" returned: 0 in 0.567s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-219996228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d72543-add2-4bc3-a26b-9bc25ca9318c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1865fa89747746da8a727b06049783c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:44Z,use_quota=True,user_id='1ea8771401e6483e8fc96bfe308b2dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Creating volume 45d72543-add2-4bc3-a26b-9bc25ca9318c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:46 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 09:58:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:47 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c 1073741824 Nov 02 09:58:47 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12778367-ae8c-4b05-9dd4-3461070d4e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865516af-686d-4a41-bcea-7d3037a367b4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f4108a-0583-4b74-ba94-39f067d34f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:47 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Volume volume-865516af-686d-4a41-bcea-7d3037a367b4 (865516af-686d-4a41-bcea-7d3037a367b4): created successfully Nov 02 09:58:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f4108a-0583-4b74-ba94-39f067d34f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Flow 'volume_create_manager' (15205b60-1e73-4119-bbac-daa14e8abc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:47 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-203c2549-468a-43ef-ae36-90e3d82bdb2b tempest-DeleteServersTestJSON-1382739657 None] Created volume successfully. Nov 02 09:58:48 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c 1073741824" returned: 0 in 1.060s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:48 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c Nov 02 09:58:48 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:48 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c" returned: 0 in 0.460s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2799b7db-f285-43e4-b631-dc14bffde604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d72543-add2-4bc3-a26b-9bc25ca9318c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca3f4ea-6187-4bad-99b1-97aba3818109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:48 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Volume volume-45d72543-add2-4bc3-a26b-9bc25ca9318c (45d72543-add2-4bc3-a26b-9bc25ca9318c): created successfully Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca3f4ea-6187-4bad-99b1-97aba3818109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Flow 'volume_create_manager' (8625729b-a66f-402f-94a4-a2bb50ed7bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-0c99f23a-1648-44e1-9ead-430981b103aa req-63c3ca0f-1718-4fbb-9a9d-a7dd171d1c53 tempest-VolumesGetTestJSON-1040367866 None] Created volume successfully. Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:48 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:58:48 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:49 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.599s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:58:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 6 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:58:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:58:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Acquiring lock "cinder-45d72543-add2-4bc3-a26b-9bc25ca9318c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Lock "cinder-45d72543-add2-4bc3-a26b-9bc25ca9318c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Acquiring lock "cinder-quobyte-45d72543-add2-4bc3-a26b-9bc25ca9318c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Lock "cinder-quobyte-45d72543-add2-4bc3-a26b-9bc25ca9318c" acquired by "delete_volume" :: waited 0.082s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:50 devstack cinder-volume[87005]: INFO oslo.privsep.daemon [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqilgwfcz/privsep.sock'] Nov 02 09:58:50 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqilgwfcz/privsep.sock Nov 02 09:58:50 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 09:58:52 devstack cinder-volume[87005]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 09:58:53 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:53 devstack cinder-volume[87005]: INFO oslo.privsep.daemon [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Spawned new privsep daemon via rootwrap Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Accepted privsep connection to /tmp/tmpqilgwfcz/privsep.sock {{(pid=87005) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 09:58:53 devstack cinder-volume[87005]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 09:58:53 devstack cinder-volume[87005]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 09:58:53 devstack cinder-volume[87005]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 09:58:53 devstack cinder-volume[87005]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87797 Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8e53f3-2b37-4daa-ad39-1c15d3a70848]: (2,) {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe83aed-e0d3-4dd9-840d-77e181089a74]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack cinder-volume[87005]: WARNING py.warnings [req-5afa5bfc-e7ff-4246-9620-93bfab46dfb1 req-c678bba6-8a4a-42ea-af8a-993bb57c855e tempest-DeleteServersTestJSON-1382739657 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 02 09:58:53 devstack cinder-volume[87005]: .first() Nov 02 09:58:53 devstack cinder-volume[87005]: Nov 02 09:58:53 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c Nov 02 09:58:53 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-5afa5bfc-e7ff-4246-9620-93bfab46dfb1 req-c678bba6-8a4a-42ea-af8a-993bb57c855e tempest-DeleteServersTestJSON-1382739657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-5afa5bfc-e7ff-4246-9620-93bfab46dfb1 req-c678bba6-8a4a-42ea-af8a-993bb57c855e tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-5afa5bfc-e7ff-4246-9620-93bfab46dfb1 req-c678bba6-8a4a-42ea-af8a-993bb57c855e tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-5afa5bfc-e7ff-4246-9620-93bfab46dfb1 req-c678bba6-8a4a-42ea-af8a-993bb57c855e tempest-DeleteServersTestJSON-1382739657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-865516af-686d-4a41-bcea-7d3037a367b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d10ead5-afd8-48f1-bb27-25c803b3895b', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:58:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-5afa5bfc-e7ff-4246-9620-93bfab46dfb1 req-c678bba6-8a4a-42ea-af8a-993bb57c855e tempest-DeleteServersTestJSON-1382739657 None] attachment_update completed successfully. Nov 02 09:58:53 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c" returned: 0 in 0.550s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c Nov 02 09:58:53 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-45d72543-add2-4bc3-a26b-9bc25ca9318c" returned: 0 in 0.415s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Lock "cinder-quobyte-45d72543-add2-4bc3-a26b-9bc25ca9318c" released by "delete_volume" :: held 3.628s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:54 devstack cinder-volume[87005]: WARNING cinder.quota [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:58:54 devstack cinder-volume[87005]: WARNING cinder.quota [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG cinder.quota [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Created reservations ['a063b98b-21a5-4238-bd8e-3d27b81aae72', 'd397fdae-8e39-4782-b077-3063a2151219', 'af031b61-f47b-4c1a-9c0c-c634a7a78550', '4b435dbe-10e2-44f1-a28b-d0f90f82f56c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:58:54 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.462s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG cinder.manager [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:54 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Deleted volume successfully. Nov 02 09:58:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d1b2c717-b4b4-47b0-a489-6d17c3061e22 req-9cb2816b-aa05-470c-8984-8f779b443d80 tempest-VolumesGetTestJSON-1040367866 None] Lock "cinder-45d72543-add2-4bc3-a26b-9bc25ca9318c-delete_volume" released by "delete_volume" :: held 4.549s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-bd00b80e-130f-4568-b892-19c8fc61ee82 req-1c786bac-16e5-4f28-8b45-631f2deca300 tempest-DeleteServersTestJSON-1382739657 None] Terminate volume connection completed successfully. Nov 02 09:59:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-bd00b80e-130f-4568-b892-19c8fc61ee82 req-1c786bac-16e5-4f28-8b45-631f2deca300 tempest-DeleteServersTestJSON-1382739657 None] Deleting attachment 5d10ead5-afd8-48f1-bb27-25c803b3895b. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:59:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-134a8c8f-8fac-4a1a-88f9-2afa7223ceba tempest-BackendsCapabilitiesAdminTestsJSON-2071302133 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87005) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 09:59:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e684bf0c-8efe-46fc-89c5-4f63132ec9af tempest-BackendsCapabilitiesAdminTestsJSON-2071302133 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87005) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 09:59:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Acquiring lock "cinder-865516af-686d-4a41-bcea-7d3037a367b4-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Lock "cinder-865516af-686d-4a41-bcea-7d3037a367b4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Acquiring lock "cinder-quobyte-865516af-686d-4a41-bcea-7d3037a367b4" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Lock "cinder-quobyte-865516af-686d-4a41-bcea-7d3037a367b4" acquired by "delete_volume" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:03 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54376e0-d01e-40df-8fbf-bf5aeca72cd0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:03 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 Nov 02 09:59:03 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:03 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4" returned: 0 in 0.783s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:03 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4 Nov 02 09:59:03 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:04 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-865516af-686d-4a41-bcea-7d3037a367b4" returned: 0 in 0.527s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Lock "cinder-quobyte-865516af-686d-4a41-bcea-7d3037a367b4" released by "delete_volume" :: held 1.383s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Created reservations ['b05437fb-5ecb-48fc-bfec-f314b04dd9a2', 'f42cba33-a905-406b-b19f-4072777821bf', 'd164c38b-a751-4a89-89ee-cf68b1510050', '3de57191-06e4-48fb-bed4-a233cd9dc748'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:04 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:59:04 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:05 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.339s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:05 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Deleted volume successfully. Nov 02 09:59:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c380b4-d8d3-4ee3-a0a9-aa6dbf42efe2 tempest-DeleteServersTestJSON-1382739657 None] Lock "cinder-865516af-686d-4a41-bcea-7d3037a367b4-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:14 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:15 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=26,cinder:SELECT=22,cinder:DELETE=4,cinder:INSERT=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3ffdb4f9-9a19-44d6-b8df-c0ad1f8d846b tempest-GroupsV320Test-263489617 None] Group tempest-GroupsV320Test-Group-759562214: creating Nov 02 09:59:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3ffdb4f9-9a19-44d6-b8df-c0ad1f8d846b tempest-GroupsV320Test-263489617 None] Group tempest-GroupsV320Test-Group-759562214: created successfully Nov 02 09:59:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3ffdb4f9-9a19-44d6-b8df-c0ad1f8d846b tempest-GroupsV320Test-263489617 None] Create group completed successfully. Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Created reservations ['50a37f4a-422c-4dbc-bb7f-dc9da1c7a4d0'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:18 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:59:18 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:18 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.396s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:18 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4884377e-58b8-42c9-b2d9-08b294007c9c tempest-GroupsV320Test-263489617 None] Delete group completed successfully. Nov 02 09:59:28 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:28 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6,cinder:INSERT=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-679f8eab-e558-4df1-a5cc-ecd47e960284 req-aea1477e-6a06-4f8c-8f0d-1e3c0fcfd270 tempest-TaggedAttachmentsTest-365475200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-679f8eab-e558-4df1-a5cc-ecd47e960284 req-aea1477e-6a06-4f8c-8f0d-1e3c0fcfd270 tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-679f8eab-e558-4df1-a5cc-ecd47e960284 req-aea1477e-6a06-4f8c-8f0d-1e3c0fcfd270 tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-679f8eab-e558-4df1-a5cc-ecd47e960284 req-aea1477e-6a06-4f8c-8f0d-1e3c0fcfd270 tempest-TaggedAttachmentsTest-365475200 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7e1e6c0-ea2c-4489-a2b6-df8954b7d9ec', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:59:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-679f8eab-e558-4df1-a5cc-ecd47e960284 req-aea1477e-6a06-4f8c-8f0d-1e3c0fcfd270 tempest-TaggedAttachmentsTest-365475200 None] attachment_update completed successfully. Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:48 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 09:59:48 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:49 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.479s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-d3caf83a-d14a-491f-ac55-c7bb3840056b req-4cfc85be-0b15-40e6-92bc-277c3afdce1e tempest-TaggedAttachmentsTest-365475200 None] Terminate volume connection completed successfully. Nov 02 09:59:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-d3caf83a-d14a-491f-ac55-c7bb3840056b req-4cfc85be-0b15-40e6-92bc-277c3afdce1e tempest-TaggedAttachmentsTest-365475200 None] Deleting attachment a7e1e6c0-ea2c-4489-a2b6-df8954b7d9ec. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:00:05 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=2,cinder:SELECT=7 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:05 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:06 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Flow 'volume_create_manager' (e84c30bc-c30e-4ace-864e-ebe1c40f4f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406936e-13a6-42ab-a384-311068e97a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406936e-13a6-42ab-a384-311068e97a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-98117895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb377da948cc4c9bb60ae7556a545e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:07Z,use_quota=True,user_id='20ac759384c143eb89fffa3e63631da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519d2f0a-823a-4125-bc2c-354ca664b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519d2f0a-823a-4125-bc2c-354ca664b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfd52f5-f4e1-4731-876a-a44d32e36ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfd52f5-f4e1-4731-876a-a44d32e36ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c', 'volume_name': 'volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4c0d55-9a11-4519-bca7-9db1189c6e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4c0d55-9a11-4519-bca7-9db1189c6e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549eab25-4fda-432a-a275-1abe1fb785c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:07 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Volume bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c', 'volume_size': 1} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-98117895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb377da948cc4c9bb60ae7556a545e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:07Z,use_quota=True,user_id='20ac759384c143eb89fffa3e63631da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Creating volume bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:07 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:07 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c 1073741824 Nov 02 10:00:07 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c 1073741824" returned: 0 in 0.774s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:07 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:08 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c Nov 02 10:00:08 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:08 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c" returned: 0 in 0.526s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549eab25-4fda-432a-a275-1abe1fb785c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05df10d0-67a4-4e24-a073-d1bad55541ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:08 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Volume volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c (bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c): created successfully Nov 02 10:00:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05df10d0-67a4-4e24-a073-d1bad55541ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Flow 'volume_create_manager' (e84c30bc-c30e-4ace-864e-ebe1c40f4f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-16ed8824-a260-4484-b6c2-af1d3ae9255f tempest-VolumeQuotasAdminTestJSON-395478092 None] Created volume successfully. Nov 02 10:00:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Acquiring lock "cinder-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "cinder-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Acquiring lock "cinder-quobyte-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "cinder-quobyte-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c" acquired by "delete_volume" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:09 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3666eb-7eae-4b08-9fa3-9423edffb661]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:09 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c Nov 02 10:00:09 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:10 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c" returned: 0 in 0.873s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:10 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c Nov 02 10:00:10 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:11 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c" returned: 0 in 0.743s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "cinder-quobyte-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c" released by "delete_volume" :: held 1.715s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Created reservations ['9bab48de-7c07-45b2-838a-aa588815a864', '30cff1a1-1f93-4e09-8cbc-85e280740b7f', '31e1e86e-5752-499e-a4ea-c09ae09d8b0f', 'b955dd5a-cf0b-4697-8fd2-271cab6704f8'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:11 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:11 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:12 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.699s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:12 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Deleted volume successfully. Nov 02 10:00:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e4b5f7d0-4e01-431d-bc53-5bd961439b7e tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "cinder-bb13c6ac-e00f-43b3-a36c-8c3c7429fb8c-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Flow 'volume_create_manager' (af1637b0-1b8d-4f9c-8767-f38abf1323e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e8b0e-76f7-41aa-a4c6-b8f10d25d207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e8b0e-76f7-41aa-a4c6-b8f10d25d207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-368816675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a0e6e6-4d93-49c7-accc-2f29d1eb473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb377da948cc4c9bb60ae7556a545e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:13Z,use_quota=True,user_id='20ac759384c143eb89fffa3e63631da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd56d63c-e959-4eab-8e76-60f5938b4f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd56d63c-e959-4eab-8e76-60f5938b4f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4c7be-86e9-4f89-a491-063fa50b4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4c7be-86e9-4f89-a491-063fa50b4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a0e6e6-4d93-49c7-accc-2f29d1eb473b', 'volume_name': 'volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd90ce6f-45db-4328-8792-1509b13a1343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd90ce6f-45db-4328-8792-1509b13a1343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214adf02-b3f6-4443-9bb0-0245563a5afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:13 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Volume a6a0e6e6-4d93-49c7-accc-2f29d1eb473b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b', 'volume_size': 1} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-368816675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a0e6e6-4d93-49c7-accc-2f29d1eb473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb377da948cc4c9bb60ae7556a545e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:13Z,use_quota=True,user_id='20ac759384c143eb89fffa3e63631da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Creating volume a6a0e6e6-4d93-49c7-accc-2f29d1eb473b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:13 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:00:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:13 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b 1073741824 Nov 02 10:00:13 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:14 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b 1073741824" returned: 0 in 1.128s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:14 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b Nov 02 10:00:14 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:15 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Flow 'volume_create_manager' (94100d1f-1815-41b3-b98f-e3a981f1af4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c823859-8ac4-4e17-80fe-0073453080d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b" returned: 0 in 0.384s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c823859-8ac4-4e17-80fe-0073453080d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-18818693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a090af0-2ab5-47c7-92d6-3c77f216b7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb667f6c78a4e42a545c198c9a90651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:15Z,use_quota=True,user_id='a7e0eb1dfd4a4977a6ba3b3ac4f754dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85794a9-40a0-44e1-93bd-d81a22184a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85794a9-40a0-44e1-93bd-d81a22184a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5a50c4-ae56-463b-8b77-d9d3e4245d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5a50c4-ae56-463b-8b77-d9d3e4245d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a090af0-2ab5-47c7-92d6-3c77f216b7f4', 'volume_name': 'volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e41e06a-181d-451a-b4d9-b434af012357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e41e06a-181d-451a-b4d9-b434af012357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68f78df-2524-47dd-bbc7-898b4a34a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:15 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Volume 9a090af0-2ab5-47c7-92d6-3c77f216b7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4', 'volume_size': 1} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-18818693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a090af0-2ab5-47c7-92d6-3c77f216b7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb667f6c78a4e42a545c198c9a90651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:15Z,use_quota=True,user_id='a7e0eb1dfd4a4977a6ba3b3ac4f754dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Creating volume 9a090af0-2ab5-47c7-92d6-3c77f216b7f4 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:15 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214adf02-b3f6-4443-9bb0-0245563a5afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33395de-428c-46f7-8cec-6617cb4f6dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:15 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 1073741824 Nov 02 10:00:15 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:15 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Volume volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b (a6a0e6e6-4d93-49c7-accc-2f29d1eb473b): created successfully Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33395de-428c-46f7-8cec-6617cb4f6dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Flow 'volume_create_manager' (af1637b0-1b8d-4f9c-8767-f38abf1323e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c90c82fe-bd69-4d3b-850d-e9d34e70bc43 tempest-VolumeQuotasAdminTestJSON-395478092 None] Created volume successfully. Nov 02 10:00:16 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 1073741824" returned: 0 in 0.793s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:16 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 Nov 02 10:00:16 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:16 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4" returned: 0 in 0.517s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68f78df-2524-47dd-bbc7-898b4a34a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb326b62-ad34-453e-b4b0-2d1245f3af53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:16 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Volume volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 (9a090af0-2ab5-47c7-92d6-3c77f216b7f4): created successfully Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb326b62-ad34-453e-b4b0-2d1245f3af53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Flow 'volume_create_manager' (94100d1f-1815-41b3-b98f-e3a981f1af4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-789de3c5-96e8-4805-ac36-add1511a3163 tempest-ServerRescueNegativeTestJSON-1900072879 None] Created volume successfully. Nov 02 10:00:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-1f71e13b-559c-4134-8202-7ecc2273384a tempest-VolumeQuotasAdminTestJSON-433140793 None] Transfer volume completed successfully. Nov 02 10:00:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Acquiring lock "cinder-326bff20-8bf2-40c3-a3cb-3f11a5e765c0-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Lock "cinder-326bff20-8bf2-40c3-a3cb-3f11a5e765c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Acquiring lock "cinder-quobyte-326bff20-8bf2-40c3-a3cb-3f11a5e765c0" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Lock "cinder-quobyte-326bff20-8bf2-40c3-a3cb-3f11a5e765c0" acquired by "delete_volume" :: waited 0.041s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:18 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d107dca-1da6-491b-9654-33280c73e98a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:18 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 Nov 02 10:00:18 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:19 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0" returned: 0 in 0.663s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:19 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0 Nov 02 10:00:19 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Acquiring lock "cinder-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Lock "cinder-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Acquiring lock "cinder-quobyte-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Lock "cinder-quobyte-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[db913fdc-f321-4112-b6f5-3a08fd7b90d7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:19 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-326bff20-8bf2-40c3-a3cb-3f11a5e765c0" returned: 0 in 0.512s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Lock "cinder-quobyte-326bff20-8bf2-40c3-a3cb-3f11a5e765c0" released by "delete_volume" :: held 1.264s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Created reservations ['520c22ec-b862-4f19-a520-9145af2f3a78', '46b5e021-d634-4a1e-8a05-64e8d162e833', 'cb3fa41e-e389-4804-baa8-709c7032259c', '22624e8d-8469-48f6-b750-57d91558df6b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:19 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b Nov 02 10:00:19 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:19 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:19 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:20 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.555s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:20 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:20 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b" returned: 0 in 0.985s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Deleted volume successfully. Nov 02 10:00:20 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b Nov 02 10:00:20 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-89e62f40-aeb3-462b-9882-b903d0a01fd1 tempest-TaggedAttachmentsTest-365475200 None] Lock "cinder-326bff20-8bf2-40c3-a3cb-3f11a5e765c0-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:20 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b" returned: 0 in 0.492s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Lock "cinder-quobyte-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b" released by "delete_volume" :: held 1.594s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Created reservations ['5f067690-5f7d-405a-8174-0be80516804b', '67810ccb-5800-4ff8-80a8-cc7daf795dab', 'ba16d736-2236-46c5-a3d8-c595e8336f0f', '98d019ee-7e77-41d1-9c93-a85d7ada4803'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:21 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:21 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:21 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.449s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Deleted volume successfully. Nov 02 10:00:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-693bf367-955a-4f11-81bb-1b9dd8aa6c56 tempest-VolumeQuotasAdminTestJSON-15633100 None] Lock "cinder-a6a0e6e6-4d93-49c7-accc-2f29d1eb473b-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:31 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=31,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:31 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=4 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Acquiring lock "cinder-9a090af0-2ab5-47c7-92d6-3c77f216b7f4-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "cinder-9a090af0-2ab5-47c7-92d6-3c77f216b7f4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Acquiring lock "cinder-quobyte-9a090af0-2ab5-47c7-92d6-3c77f216b7f4" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "cinder-quobyte-9a090af0-2ab5-47c7-92d6-3c77f216b7f4" acquired by "delete_volume" :: waited 0.063s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb1324d-e0e2-4333-bceb-05ca1819a4b6]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:38 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 Nov 02 10:00:38 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:39 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4" returned: 0 in 1.097s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:39 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4 Nov 02 10:00:39 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:40 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9a090af0-2ab5-47c7-92d6-3c77f216b7f4" returned: 0 in 0.634s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "cinder-quobyte-9a090af0-2ab5-47c7-92d6-3c77f216b7f4" released by "delete_volume" :: held 1.882s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Created reservations ['b377674e-adf2-4fdb-9140-1fe54c03ee51', '943ba7fb-8435-4067-b9e1-33d2cace6774', '3e06e609-d361-44fc-ae6d-74db738cbd8a', '3f63abcc-1b90-4141-9e93-305d000baa55'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:40 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:40 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:41 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.429s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:41 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Deleted volume successfully. Nov 02 10:00:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3b8eacab-af92-4933-bb95-96e512bf46aa tempest-ServerRescueNegativeTestJSON-1900072879 None] Lock "cinder-9a090af0-2ab5-47c7-92d6-3c77f216b7f4-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:41 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Flow 'volume_create_manager' (24bcb90e-5fba-46dd-8918-f984d96ee111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59130bf-a5ce-434c-b201-250831399a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59130bf-a5ce-434c-b201-250831399a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2059735595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d8a843-5983-43c4-ac7e-85078f18cf82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f3bacf72344edea8a728a9d7cd0b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:42Z,use_quota=True,user_id='48661ef877aa47ceacb8ced5e09b42a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a105bc-bf69-4928-b6f7-526fd86d6def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a105bc-bf69-4928-b6f7-526fd86d6def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d59f3b-e433-43e5-8533-a2cea2678784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d59f3b-e433-43e5-8533-a2cea2678784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d8a843-5983-43c4-ac7e-85078f18cf82', 'volume_name': 'volume-b7d8a843-5983-43c4-ac7e-85078f18cf82', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208ed868-a774-4095-8230-3223041f2466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208ed868-a774-4095-8230-3223041f2466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e24153-c204-43f9-a70a-8134d8d87fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:42 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Volume b7d8a843-5983-43c4-ac7e-85078f18cf82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d8a843-5983-43c4-ac7e-85078f18cf82', 'volume_size': 1} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2059735595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d8a843-5983-43c4-ac7e-85078f18cf82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f3bacf72344edea8a728a9d7cd0b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:42Z,use_quota=True,user_id='48661ef877aa47ceacb8ced5e09b42a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Creating volume b7d8a843-5983-43c4-ac7e-85078f18cf82 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:42 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:00:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:42 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 1073741824 Nov 02 10:00:42 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:44 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 1073741824" returned: 0 in 1.858s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:44 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 Nov 02 10:00:44 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:45 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82" returned: 0 in 1.079s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] <== create_volume: return (3132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.146s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e24153-c204-43f9-a70a-8134d8d87fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d8a843-5983-43c4-ac7e-85078f18cf82', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9b2632-1697-4b58-89b1-4f656a8df2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Volume volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 (b7d8a843-5983-43c4-ac7e-85078f18cf82): created successfully Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9b2632-1697-4b58-89b1-4f656a8df2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Flow 'volume_create_manager' (24bcb90e-5fba-46dd-8918-f984d96ee111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-417134f1-01c1-4a81-9b7c-662bed73e873 tempest-VolumesAdminNegativeTest-720868970 None] Created volume successfully. Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Flow 'volume_create_manager' (05fc863a-f082-4402-837c-06d575417a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14da77e5-ba28-4b20-9c19-bd488e51c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14da77e5-ba28-4b20-9c19-bd488e51c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1838832947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ed6568-a745-44eb-a508-bc39e1c674a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370fc0e7ecb44569fdc1ebad32bf6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:46Z,use_quota=True,user_id='61680498230a487994a45d7fbf0703b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a860e8d4-0ce1-48b0-a8d5-b5e7bb15f935),volume_type_id=a860e8d4-0ce1-48b0-a8d5-b5e7bb15f935)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3776e4e-e166-4fb2-be22-45435eed66cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3776e4e-e166-4fb2-be22-45435eed66cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056b0f78-ef73-49c9-9d87-81f86b9c2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056b0f78-ef73-49c9-9d87-81f86b9c2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ed6568-a745-44eb-a508-bc39e1c674a3', 'volume_name': 'volume-e3ed6568-a745-44eb-a508-bc39e1c674a3', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f5d741-64e0-4c25-8b3f-37af420a7cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f5d741-64e0-4c25-8b3f-37af420a7cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43c7507-b533-4a2a-b2b0-385044a40c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Volume e3ed6568-a745-44eb-a508-bc39e1c674a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ed6568-a745-44eb-a508-bc39e1c674a3', 'volume_size': 1} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1838832947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ed6568-a745-44eb-a508-bc39e1c674a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370fc0e7ecb44569fdc1ebad32bf6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:46Z,use_quota=True,user_id='61680498230a487994a45d7fbf0703b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a860e8d4-0ce1-48b0-a8d5-b5e7bb15f935),volume_type_id=a860e8d4-0ce1-48b0-a8d5-b5e7bb15f935)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Creating volume e3ed6568-a745-44eb-a508-bc39e1c674a3 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:45 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:00:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:45 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 1073741824 Nov 02 10:00:45 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:47 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 1073741824" returned: 0 in 1.383s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:47 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 Nov 02 10:00:47 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:47 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3" returned: 0 in 0.539s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43c7507-b533-4a2a-b2b0-385044a40c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ed6568-a745-44eb-a508-bc39e1c674a3', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02d41da-ee9c-42f0-b2b1-0d210f8dc841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:48 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Volume volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 (e3ed6568-a745-44eb-a508-bc39e1c674a3): created successfully Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02d41da-ee9c-42f0-b2b1-0d210f8dc841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Flow 'volume_create_manager' (05fc863a-f082-4402-837c-06d575417a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-44faa0e6-6f16-424d-b36a-68b7c266cfc5 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Created volume successfully. Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Acquiring lock "cinder-b7d8a843-5983-43c4-ac7e-85078f18cf82-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Lock "cinder-b7d8a843-5983-43c4-ac7e-85078f18cf82-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Acquiring lock "cinder-quobyte-b7d8a843-5983-43c4-ac7e-85078f18cf82" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Lock "cinder-quobyte-b7d8a843-5983-43c4-ac7e-85078f18cf82" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[183ab227-92df-472a-a446-247dd780f205]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:48 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 Nov 02 10:00:48 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:48 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:48 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:49 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82" returned: 0 in 0.721s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:49 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82 Nov 02 10:00:49 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:49 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.586s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:00:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 8 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:00:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:00:50 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b7d8a843-5983-43c4-ac7e-85078f18cf82" returned: 0 in 0.924s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Lock "cinder-quobyte-b7d8a843-5983-43c4-ac7e-85078f18cf82" released by "delete_volume" :: held 1.768s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:50 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:50 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Created reservations ['4ca4c961-7a52-438f-8787-274520ac1121', '0ffb15f7-8451-4cc9-bfaa-cb64d77c73e0', '6c0830d0-e64c-4323-a41f-d71034de999c', '91c367a5-c730-44e2-b229-92e3893eb1c7'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:50 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:50 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:50 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.488s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:50 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Deleted volume successfully. Nov 02 10:00:51 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.868s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:51 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-137bb726-5426-4e4b-be78-3c13083b40c8 tempest-VolumesAdminNegativeTest-720868970 None] Lock "cinder-b7d8a843-5983-43c4-ac7e-85078f18cf82-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-518000d5-6ec3-448d-be11-6388ebc5ad0e tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Retype volume completed successfully. Nov 02 10:00:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Acquiring lock "cinder-e3ed6568-a745-44eb-a508-bc39e1c674a3-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "cinder-e3ed6568-a745-44eb-a508-bc39e1c674a3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Acquiring lock "cinder-quobyte-e3ed6568-a745-44eb-a508-bc39e1c674a3" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "cinder-quobyte-e3ed6568-a745-44eb-a508-bc39e1c674a3" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:52 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[29883be9-b512-4e71-965f-4e9f94d956de]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:52 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 Nov 02 10:00:52 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:53 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3" returned: 0 in 0.511s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:53 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3 Nov 02 10:00:53 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:53 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ed6568-a745-44eb-a508-bc39e1c674a3" returned: 0 in 0.341s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "cinder-quobyte-e3ed6568-a745-44eb-a508-bc39e1c674a3" released by "delete_volume" :: held 0.928s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:53 devstack cinder-volume[87005]: WARNING cinder.quota [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:53 devstack cinder-volume[87005]: WARNING cinder.quota [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Created reservations ['2b8e641f-65a9-4961-a4de-4d1473c2de8d', 'e9bc0b0b-12bc-49ff-b229-e45b14985289', '52d52dd9-7795-4e77-b3e0-7056622a5ee7', '8298650c-b398-432c-bb0d-987ea2366a27'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:53 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:00:53 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:53 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.316s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Deleted volume successfully. Nov 02 10:00:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6c1b22-800e-4d3c-9ce9-bd0bef396920 tempest-VolumeRetypeWithoutMigrationTest-1517883286 None] Lock "cinder-e3ed6568-a745-44eb-a508-bc39e1c674a3-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:03 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:03 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=31,cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Flow 'volume_create_manager' (da8616fe-5f4f-4e05-8658-254ae021c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3cbd6c-a859-47ff-8f61-669df3fa2531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3cbd6c-a859-47ff-8f61-669df3fa2531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-683010321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e3af10-103b-4f47-b576-de6e5a3dc198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf35e45c0894f1a9db57542ce061b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:11Z,use_quota=True,user_id='9736b87488a942108c3e253ccb85562a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8a30e7-47a6-4072-a5c8-6a732e9323e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8a30e7-47a6-4072-a5c8-6a732e9323e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de166497-7cb4-4558-b18c-3c27db917bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de166497-7cb4-4558-b18c-3c27db917bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e3af10-103b-4f47-b576-de6e5a3dc198', 'volume_name': 'volume-82e3af10-103b-4f47-b576-de6e5a3dc198', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba965df9-efef-4681-9881-c5e0904e189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba965df9-efef-4681-9881-c5e0904e189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50760fa-dd88-4a79-bb8c-ac0238a32cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:10 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Volume 82e3af10-103b-4f47-b576-de6e5a3dc198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e3af10-103b-4f47-b576-de6e5a3dc198', 'volume_size': 1} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-683010321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e3af10-103b-4f47-b576-de6e5a3dc198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf35e45c0894f1a9db57542ce061b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:11Z,use_quota=True,user_id='9736b87488a942108c3e253ccb85562a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Creating volume 82e3af10-103b-4f47-b576-de6e5a3dc198 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:10 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:01:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:10 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 1073741824 Nov 02 10:01:10 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:11 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 1073741824" returned: 0 in 0.523s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:11 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 Nov 02 10:01:11 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:11 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198" returned: 0 in 0.398s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50760fa-dd88-4a79-bb8c-ac0238a32cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e3af10-103b-4f47-b576-de6e5a3dc198', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddcec2b-18e5-4b8b-aed2-ae72d7d1a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:11 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Volume volume-82e3af10-103b-4f47-b576-de6e5a3dc198 (82e3af10-103b-4f47-b576-de6e5a3dc198): created successfully Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddcec2b-18e5-4b8b-aed2-ae72d7d1a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Flow 'volume_create_manager' (da8616fe-5f4f-4e05-8658-254ae021c972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-aeac9194-cf12-4ada-a65b-66cd71e6aee8 tempest-VolumesServicesTestJSON-1155467958 None] Created volume successfully. Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Acquiring lock "cinder-82e3af10-103b-4f47-b576-de6e5a3dc198-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Lock "cinder-82e3af10-103b-4f47-b576-de6e5a3dc198-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Acquiring lock "cinder-quobyte-82e3af10-103b-4f47-b576-de6e5a3dc198" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Lock "cinder-quobyte-82e3af10-103b-4f47-b576-de6e5a3dc198" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b51f5-6657-4f23-80eb-44fe5f2a86cc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:13 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 Nov 02 10:01:13 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:13 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198" returned: 0 in 0.516s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:13 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198 Nov 02 10:01:13 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:14 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82e3af10-103b-4f47-b576-de6e5a3dc198" returned: 0 in 0.329s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Lock "cinder-quobyte-82e3af10-103b-4f47-b576-de6e5a3dc198" released by "delete_volume" :: held 0.915s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Created reservations ['0c2afe98-0434-4d13-81ab-e9dbbe5f1ad7', '5187327f-e7f5-42ab-b6c6-dbe80accd041', '15f3355d-a157-449b-bef7-d40fd54da72a', 'c243baa6-65e3-43ef-8f62-9e599d89d5e5'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:14 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:01:14 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:14 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.320s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Deleted volume successfully. Nov 02 10:01:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5a5716a1-b32e-4ccc-b3a0-f9e115dc380e tempest-VolumesServicesTestJSON-1155467958 None] Lock "cinder-82e3af10-103b-4f47-b576-de6e5a3dc198-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:24 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:24 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:01:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:48 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:01:48 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:49 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.692s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:01:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 8 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:01:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:01:55 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:55 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Flow 'volume_create_manager' (d9225909-9688-47b3-932c-5dca549776c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639ffd05-b002-4304-bcfa-b77c31d3c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639ffd05-b002-4304-bcfa-b77c31d3c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-149503729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10750c87-5efd-420f-ab66-7692c0bb548a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc4815b205048239e5df5553dc79bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:09Z,use_quota=True,user_id='a60dc82263b345bfb9a497d193b764b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18093d3a-6a72-4929-a7a1-03723a2f2f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18093d3a-6a72-4929-a7a1-03723a2f2f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cffe04a-13de-4e5c-965f-1708cb83f4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cffe04a-13de-4e5c-965f-1708cb83f4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10750c87-5efd-420f-ab66-7692c0bb548a', 'volume_name': 'volume-10750c87-5efd-420f-ab66-7692c0bb548a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e559bc8-8016-4d64-b2db-5e174cbd4718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e559bc8-8016-4d64-b2db-5e174cbd4718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3b1b76-59e4-48da-bb11-4f006c8bd271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Volume 10750c87-5efd-420f-ab66-7692c0bb548a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10750c87-5efd-420f-ab66-7692c0bb548a', 'volume_size': 1} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-149503729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10750c87-5efd-420f-ab66-7692c0bb548a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc4815b205048239e5df5553dc79bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:09Z,use_quota=True,user_id='a60dc82263b345bfb9a497d193b764b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Creating volume 10750c87-5efd-420f-ab66-7692c0bb548a {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:09 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:09 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a 1073741824 Nov 02 10:02:09 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:09 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a 1073741824" returned: 0 in 0.546s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:09 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a Nov 02 10:02:09 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:10 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a" returned: 0 in 0.463s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3b1b76-59e4-48da-bb11-4f006c8bd271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10750c87-5efd-420f-ab66-7692c0bb548a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93970bfd-3ebb-45b8-9f5e-36ecaece220a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:10 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Volume volume-10750c87-5efd-420f-ab66-7692c0bb548a (10750c87-5efd-420f-ab66-7692c0bb548a): created successfully Nov 02 10:02:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93970bfd-3ebb-45b8-9f5e-36ecaece220a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Flow 'volume_create_manager' (d9225909-9688-47b3-932c-5dca549776c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:10 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-edc63cba-6373-4bc4-8a48-75855a212ef7 tempest-ServersNegativeTestJSON-668568297 None] Created volume successfully. Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Flow 'volume_create_manager' (e4810192-863f-4546-85eb-7827c488ca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e5f82c-a216-43af-b0b8-af3b90dd9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e5f82c-a216-43af-b0b8-af3b90dd9b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1830071289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a458c3-f71e-4bbd-86b2-6745e436994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc4815b205048239e5df5553dc79bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:13Z,use_quota=True,user_id='a60dc82263b345bfb9a497d193b764b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485017f2-9ac9-49a0-9ba1-c555948d6898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485017f2-9ac9-49a0-9ba1-c555948d6898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2f65db-7208-4bbe-bcf8-457f4ae642d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2f65db-7208-4bbe-bcf8-457f4ae642d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a458c3-f71e-4bbd-86b2-6745e436994e', 'volume_name': 'volume-20a458c3-f71e-4bbd-86b2-6745e436994e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4922d6c3-b046-412f-b548-3b7b68cf64b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4922d6c3-b046-412f-b548-3b7b68cf64b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f44df05-155a-4410-ab94-ea2efbeaf1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:13 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Volume 20a458c3-f71e-4bbd-86b2-6745e436994e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a458c3-f71e-4bbd-86b2-6745e436994e', 'volume_size': 1} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1830071289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a458c3-f71e-4bbd-86b2-6745e436994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc4815b205048239e5df5553dc79bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:13Z,use_quota=True,user_id='a60dc82263b345bfb9a497d193b764b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Creating volume 20a458c3-f71e-4bbd-86b2-6745e436994e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:13 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:02:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:13 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e 1073741824 Nov 02 10:02:13 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:14 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e 1073741824" returned: 0 in 1.057s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:14 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e Nov 02 10:02:14 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:15 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e" returned: 0 in 0.392s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f44df05-155a-4410-ab94-ea2efbeaf1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a458c3-f71e-4bbd-86b2-6745e436994e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35838c-e017-47a4-b389-b7f8549bc25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:15 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Volume volume-20a458c3-f71e-4bbd-86b2-6745e436994e (20a458c3-f71e-4bbd-86b2-6745e436994e): created successfully Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35838c-e017-47a4-b389-b7f8549bc25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Flow 'volume_create_manager' (e4810192-863f-4546-85eb-7827c488ca6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c931de2b-a50b-4643-bf17-af56928dd3cd tempest-ServersNegativeTestJSON-668568297 None] Created volume successfully. Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Flow 'volume_create_manager' (3b3bed70-c701-4f4f-a561-806da14ef513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8553e63-5300-4d10-9f0f-0b1f4d9abde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8553e63-5300-4d10-9f0f-0b1f4d9abde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-673853826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e069b17-2593-4558-af6f-629cd48b2f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc211c146d2c437796e542b379749616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:15Z,use_quota=True,user_id='a8c2c675938a4a2e8445588c106c448a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0834364-e318-4963-8c4b-e39a61925b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0834364-e318-4963-8c4b-e39a61925b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3974c5-b709-429a-a0de-77290a2f5395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3974c5-b709-429a-a0de-77290a2f5395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e069b17-2593-4558-af6f-629cd48b2f00', 'volume_name': 'volume-6e069b17-2593-4558-af6f-629cd48b2f00', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30127ca-2751-42f5-a5d9-8b5ceab69f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30127ca-2751-42f5-a5d9-8b5ceab69f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1abd6c2-0242-4b2f-b351-7b7d4202f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:15 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Volume 6e069b17-2593-4558-af6f-629cd48b2f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e069b17-2593-4558-af6f-629cd48b2f00', 'volume_size': 1} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-673853826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e069b17-2593-4558-af6f-629cd48b2f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc211c146d2c437796e542b379749616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:15Z,use_quota=True,user_id='a8c2c675938a4a2e8445588c106c448a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Creating volume 6e069b17-2593-4558-af6f-629cd48b2f00 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:15 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:15 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 1073741824 Nov 02 10:02:15 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:15 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 1073741824" returned: 0 in 0.567s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:15 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 Nov 02 10:02:15 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:16 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00" returned: 0 in 0.411s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1abd6c2-0242-4b2f-b351-7b7d4202f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e069b17-2593-4558-af6f-629cd48b2f00', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75904c77-2983-48ef-bb00-a8916b122603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:16 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Volume volume-6e069b17-2593-4558-af6f-629cd48b2f00 (6e069b17-2593-4558-af6f-629cd48b2f00): created successfully Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75904c77-2983-48ef-bb00-a8916b122603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Flow 'volume_create_manager' (3b3bed70-c701-4f4f-a561-806da14ef513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-213acfaf-4ce4-4b9d-a5f3-c2bcb52943ab tempest-AttachVolumeShelveTestJSON-21280312 None] Created volume successfully. Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "cinder-20a458c3-f71e-4bbd-86b2-6745e436994e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-20a458c3-f71e-4bbd-86b2-6745e436994e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "cinder-quobyte-20a458c3-f71e-4bbd-86b2-6745e436994e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-quobyte-20a458c3-f71e-4bbd-86b2-6745e436994e" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:17 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[62673a66-621c-48e4-8723-4c3e146e1f63]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:17 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e Nov 02 10:02:17 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:17 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e" returned: 0 in 0.645s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:17 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e Nov 02 10:02:17 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:18 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20a458c3-f71e-4bbd-86b2-6745e436994e" returned: 0 in 0.535s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-quobyte-20a458c3-f71e-4bbd-86b2-6745e436994e" released by "delete_volume" :: held 1.252s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Created reservations ['6f573d84-6491-422f-9648-b8ccc6441971', '2da2006d-3225-429d-af8e-77a8db2056f3', 'afee1cd1-aad6-4dbd-9155-5198cd598c89', '76acb41f-a45f-49bf-947a-0ad6d9c4e5da'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:18 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:02:18 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:18 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.367s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Deleted volume successfully. Nov 02 10:02:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a591f8f4-3182-42b7-9e39-6639d2de50cd tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-20a458c3-f71e-4bbd-86b2-6745e436994e-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "cinder-10750c87-5efd-420f-ab66-7692c0bb548a-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-10750c87-5efd-420f-ab66-7692c0bb548a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "cinder-quobyte-10750c87-5efd-420f-ab66-7692c0bb548a" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-quobyte-10750c87-5efd-420f-ab66-7692c0bb548a" acquired by "delete_volume" :: waited 0.045s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:19 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cef2ba-e824-4e25-93eb-d7a10ec6ac32]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:19 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a Nov 02 10:02:19 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:20 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a" returned: 0 in 0.607s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:20 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a Nov 02 10:02:20 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:20 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-10750c87-5efd-420f-ab66-7692c0bb548a" returned: 0 in 0.525s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-quobyte-10750c87-5efd-420f-ab66-7692c0bb548a" released by "delete_volume" :: held 1.265s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:20 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Created reservations ['596feb87-2c4d-429f-a69a-14974a2c1de5', '80a73c12-e6a7-4628-b92a-d33448ee81d3', 'e614e333-4ed6-4fd7-bed9-e913ab44c981', '2a92d21d-9e88-4bc0-939e-cc7cdb4c5edb'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:21 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:02:21 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:21 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.367s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Deleted volume successfully. Nov 02 10:02:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0480fbc3-6ff6-4de0-a9c1-0cbae6b76a5c tempest-ServersNegativeTestJSON-668568297 None] Lock "cinder-10750c87-5efd-420f-ab66-7692c0bb548a-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:31 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=30,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:31 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-bc213ae6-b6ff-44b2-bbc7-64d3062a0747 req-14725f91-06b0-42c4-88c8-fdd89225958a tempest-AttachVolumeShelveTestJSON-21280312 None] No connector for attachment a781cd55-3312-417d-a3bf-2c05153f3c1a; skipping storage backend terminate_connection call. {{(pid=87005) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 10:02:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-bc213ae6-b6ff-44b2-bbc7-64d3062a0747 req-14725f91-06b0-42c4-88c8-fdd89225958a tempest-AttachVolumeShelveTestJSON-21280312 None] Deleting attachment a781cd55-3312-417d-a3bf-2c05153f3c1a. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:02:42 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:42 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (c85d617e-27b7-46da-ac35-109cfd6d1233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de8f1bd-8711-4f33-843f-f76e7ee0c2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de8f1bd-8711-4f33-843f-f76e7ee0c2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-203233896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb93f53-c68b-4a4b-a833-e1fb84ce304e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:43Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375d9c3d-a34b-46d6-a853-270783242bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375d9c3d-a34b-46d6-a853-270783242bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50df466c-dbda-4c7a-87ce-970984b18028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50df466c-dbda-4c7a-87ce-970984b18028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb93f53-c68b-4a4b-a833-e1fb84ce304e', 'volume_name': 'volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42afbaad-9e40-439a-ad9f-b4a2c0e11de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42afbaad-9e40-439a-ad9f-b4a2c0e11de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e467ba-eed4-4f4f-af4a-7d777fc06c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:43 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Volume dcb93f53-c68b-4a4b-a833-e1fb84ce304e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e', 'volume_size': 1} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-203233896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb93f53-c68b-4a4b-a833-e1fb84ce304e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:43Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Creating volume dcb93f53-c68b-4a4b-a833-e1fb84ce304e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:43 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:02:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:43 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e 1073741824 Nov 02 10:02:43 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:44 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e 1073741824" returned: 0 in 0.983s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:45 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e Nov 02 10:02:45 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Flow 'volume_create_manager' (0f278c25-b453-4d1c-b02f-273f61dfc04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13c0414-9532-4c09-bdbb-44cefe98e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13c0414-9532-4c09-bdbb-44cefe98e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1996333300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4bb539-2c48-40cf-9377-bb544bf8ecaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0328adf212c14f9aa6a6cbba0afda6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:45Z,use_quota=True,user_id='1bd1fcfee8084e889bff91e676f4bc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121c1499-40e1-4bfc-ba9f-8c6a5a60bb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121c1499-40e1-4bfc-ba9f-8c6a5a60bb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcba4ef-74c7-40b3-bd87-6ee151145599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcba4ef-74c7-40b3-bd87-6ee151145599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4bb539-2c48-40cf-9377-bb544bf8ecaa', 'volume_name': 'volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5491d1ee-b077-4af4-ad92-ce5eea86de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5491d1ee-b077-4af4-ad92-ce5eea86de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a0152b-0675-4f1d-8c05-f11dac5defa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Volume 1c4bb539-2c48-40cf-9377-bb544bf8ecaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa', 'volume_size': 1} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:45 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" returned: 0 in 0.555s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1996333300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4bb539-2c48-40cf-9377-bb544bf8ecaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0328adf212c14f9aa6a6cbba0afda6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:45Z,use_quota=True,user_id='1bd1fcfee8084e889bff91e676f4bc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Creating volume 1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:45 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e467ba-eed4-4f4f-af4a-7d777fc06c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:45 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa 1073741824 Nov 02 10:02:45 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfc5b12-5934-48bd-a4cf-5b6da0bfdaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Volume volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e (dcb93f53-c68b-4a4b-a833-e1fb84ce304e): created successfully Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfc5b12-5934-48bd-a4cf-5b6da0bfdaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (c85d617e-27b7-46da-ac35-109cfd6d1233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-24606b14-e28c-44cd-8902-9bb246bb0bdb tempest-VolumesActionsTest-1722549982 None] Created volume successfully. Nov 02 10:02:46 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa 1073741824" returned: 0 in 0.636s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:46 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa Nov 02 10:02:46 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a963b3cc-8e29-416c-a9bd-651fa454d999 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" by "attach_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a963b3cc-8e29-416c-a9bd-651fa454d999 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" acquired by "attach_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a963b3cc-8e29-416c-a9bd-651fa454d999 tempest-VolumesActionsTest-1722549982 None] Attaching volume dcb93f53-c68b-4a4b-a833-e1fb84ce304e to instance fb64095f-5b66-4c6b-b654-c65cf058e758 at mountpoint /dev/vdb on host None. Nov 02 10:02:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a963b3cc-8e29-416c-a9bd-651fa454d999 tempest-VolumesActionsTest-1722549982 None] Attach volume completed successfully. Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a963b3cc-8e29-416c-a9bd-651fa454d999 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" released by "attach_volume" :: held 0.134s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:46 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" returned: 0 in 0.404s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a0152b-0675-4f1d-8c05-f11dac5defa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b7b111-aeb9-4ba6-8f67-4d756a3f290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Volume volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa (1c4bb539-2c48-40cf-9377-bb544bf8ecaa): created successfully Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b7b111-aeb9-4ba6-8f67-4d756a3f290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Flow 'volume_create_manager' (0f278c25-b453-4d1c-b02f-273f61dfc04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-3c62df38-b616-424d-b103-5ef9cd777224 req-d8eaa1f3-ab33-4b58-a8a5-0eec3dc7f2e2 tempest-VolumesSnapshotsTestJSON-1028497395 None] Created volume successfully. Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Creating offline snapshot 05c1298c-dda7-4b71-bae3-390f123dc960 of volume 1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e84e568-00f9-4e1b-9d60-8668b8026618]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-836aae05-fbb3-48fe-902f-5475f20a6cde tempest-VolumesActionsTest-1064120499 None] Terminate volume connection completed successfully. Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-836aae05-fbb3-48fe-902f-5475f20a6cde tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-detach_volume" by "detach_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-836aae05-fbb3-48fe-902f-5475f20a6cde tempest-VolumesActionsTest-1064120499 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:48 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa Nov 02 10:02:48 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-836aae05-fbb3-48fe-902f-5475f20a6cde tempest-VolumesActionsTest-1064120499 None] Detaching volume dcb93f53-c68b-4a4b-a833-e1fb84ce304e from instance fb64095f-5b66-4c6b-b654-c65cf058e758. Nov 02 10:02:48 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:02:48 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Flow 'volume_create_manager' (6c8e677e-b157-46a9-9dd4-3f9c3976bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909b340b-1baa-4a82-a490-ff7a687ad115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909b340b-1baa-4a82-a490-ff7a687ad115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1226860652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe86ec8-9a7d-4281-a198-c4a763c4305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db109d18250c4768970368c3a2cae584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:49Z,use_quota=True,user_id='56d2d6ea0f3e4064b0f9256c4ae01c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f876b5-51a4-42e7-a437-716061d14fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f876b5-51a4-42e7-a437-716061d14fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d11bbdf-2b09-4586-a667-eeaa6d315fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d11bbdf-2b09-4586-a667-eeaa6d315fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe86ec8-9a7d-4281-a198-c4a763c4305f', 'volume_name': 'volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681e8c30-6e64-41a3-9f3b-d65c5f73530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681e8c30-6e64-41a3-9f3b-d65c5f73530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b3d013-5ee4-4081-92db-dbb2eae9fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:49 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Volume 9fe86ec8-9a7d-4281-a198-c4a763c4305f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f', 'volume_size': 1} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-836aae05-fbb3-48fe-902f-5475f20a6cde tempest-VolumesActionsTest-1064120499 None] Detach volume completed successfully. Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-836aae05-fbb3-48fe-902f-5475f20a6cde tempest-VolumesActionsTest-1064120499 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-detach_volume" released by "detach_volume" :: held 0.532s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:49 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" returned: 0 in 1.077s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:49 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.697s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 8 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:02:49 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 1G Nov 02 10:02:49 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0d604fbc-19af-4b74-86df-d1a66188aa56 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-detach_volume" by "detach_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0d604fbc-19af-4b74-86df-d1a66188aa56 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0d604fbc-19af-4b74-86df-d1a66188aa56 tempest-VolumesActionsTest-1722549982 None] Volume detach called, but volume not attached. Nov 02 10:02:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0d604fbc-19af-4b74-86df-d1a66188aa56 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:50 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 1G" returned: 0 in 0.924s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:50 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 Nov 02 10:02:50 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "cinder-quobyte-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-quobyte-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" acquired by "delete_volume" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[464872fb-3761-491a-b0ae-7ecc541b41ad]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:50 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e Nov 02 10:02:50 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:50 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960" returned: 0 in 0.587s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:50 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 is being set with open permissions: ugo+rw Nov 02 10:02:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:51 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 Nov 02 10:02:51 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:51 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" returned: 0 in 0.991s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:51 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e Nov 02 10:02:51 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:51 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960" returned: 0 in 0.740s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:51 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.info Nov 02 10:02:51 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:52 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" returned: 0 in 0.815s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-quobyte-dcb93f53-c68b-4a4b-a833-e1fb84ce304e" released by "delete_volume" :: held 1.924s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:52 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.info" returned: 0 in 0.796s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:52 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.info is being set with open permissions: ugo+rw Nov 02 10:02:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:52 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.info Nov 02 10:02:52 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:52 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Created reservations ['631cc957-3769-40b5-82b2-fbee0a22c916', 'e06fd66e-f717-47d0-8d68-4cb1023e48e5', '7dde511c-c897-4322-ae9c-66b2079a3e3f', '21c9e00f-5045-4bd2-a474-8904c0a2eac7'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:53 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:02:53 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:53 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.info" returned: 0 in 0.618s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.974s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.987s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1226860652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe86ec8-9a7d-4281-a198-c4a763c4305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db109d18250c4768970368c3a2cae584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:49Z,use_quota=True,user_id='56d2d6ea0f3e4064b0f9256c4ae01c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Creating volume 9fe86ec8-9a7d-4281-a198-c4a763c4305f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:53 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:53 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f 1073741824 Nov 02 10:02:53 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-b5b55698-1f2b-4b45-922e-9690752ea872 req-f287e01c-e58f-4ad1-92c1-2f41c87ce654 tempest-VolumesSnapshotsTestJSON-1028497395 None] Create snapshot completed successfully Nov 02 10:02:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "cinder-05c1298c-dda7-4b71-bae3-390f123dc960-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-05c1298c-dda7-4b71-bae3-390f123dc960-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "cinder-quobyte-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-quobyte-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "cinder-quobyte-05c1298c-dda7-4b71-bae3-390f123dc960" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:54 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 1.090s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:54 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Deleted volume successfully. Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-quobyte-05c1298c-dda7-4b71-bae3-390f123dc960" acquired by "_delete_snapshot" :: waited 0.146s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Deleting offline snapshot 05c1298c-dda7-4b71-bae3-390f123dc960 of volume 1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] snapshot_file for this snap is: volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[88943c17-e049-4b4d-a0d0-4589dcdc96b4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5ab2ca6-a95f-40b0-85de-cc983f85bd78 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-dcb93f53-c68b-4a4b-a833-e1fb84ce304e-delete_volume" released by "delete_volume" :: held 3.970s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:54 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 Nov 02 10:02:54 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:54 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f 1073741824" returned: 0 in 1.585s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:55 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f Nov 02 10:02:55 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:55 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960" returned: 0 in 0.955s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[447349f7-6957-4cf9-aa7a-749768a3c319]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:55 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f" returned: 0 in 0.594s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] <== create_volume: return (2369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.379s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b3d013-5ee4-4081-92db-dbb2eae9fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b9b78-957d-4234-81a6-5f8ecee3ec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:55 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Volume volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f (9fe86ec8-9a7d-4281-a198-c4a763c4305f): created successfully Nov 02 10:02:55 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b9b78-957d-4234-81a6-5f8ecee3ec78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:55 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Flow 'volume_create_manager' (6c8e677e-b157-46a9-9dd4-3f9c3976bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-1d3909c2-6a21-4d5d-bb98-6bb1c3594f5f tempest-ServerActionsTestOtherA-1451225399 None] Created volume successfully. Nov 02 10:02:56 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" returned: 0 in 0.836s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:56 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 Nov 02 10:02:56 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:57 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960" returned: 0 in 0.849s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:57 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960 Nov 02 10:02:57 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:57 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa.05c1298c-dda7-4b71-bae3-390f123dc960" returned: 0 in 0.449s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-quobyte-05c1298c-dda7-4b71-bae3-390f123dc960" released by "_delete_snapshot" :: held 3.467s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-quobyte-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" released by "delete_snapshot" :: held 3.632s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:57 devstack cinder-volume[87005]: WARNING cinder.quota [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:02:57 devstack cinder-volume[87005]: DEBUG cinder.quota [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Created reservations ['7ee7b8a9-18c3-41c9-a3a6-af380446b4b3', '8b34aeb8-7420-4492-a0d3-f0394e1c6e2b', '2b332eaa-11a1-4eca-a5f7-1c2456cce714', '43f567c7-3234-4dbe-a08c-804c4aa6805d'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:58 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Delete snapshot completed successfully. Nov 02 10:02:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-cf4a48ef-a64f-4e25-a952-d571a918ba7a req-aa9748f4-38a5-4b39-bdef-015831c255b3 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-05c1298c-dda7-4b71-bae3-390f123dc960-delete_snapshot" released by "delete_snapshot" :: held 4.004s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "cinder-1c4bb539-2c48-40cf-9377-bb544bf8ecaa-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-1c4bb539-2c48-40cf-9377-bb544bf8ecaa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "cinder-quobyte-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-quobyte-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd4b35a-8f59-41a3-825d-962789c60849]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:59 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa Nov 02 10:02:59 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:59 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" returned: 0 in 0.554s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:59 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa Nov 02 10:02:59 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:59 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" returned: 0 in 0.492s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-quobyte-1c4bb539-2c48-40cf-9377-bb544bf8ecaa" released by "delete_volume" :: held 1.176s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (89724310-1119-425d-9557-3281fdc7774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d81469-328a-4d11-af13-468ba03171ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d81469-328a-4d11-af13-468ba03171ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100387051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:00Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930c218c-d062-49a0-8731-da0944a98291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930c218c-d062-49a0-8731-da0944a98291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ea80c8-91e2-4185-8d71-d4273dcfbb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ea80c8-91e2-4185-8d71-d4273dcfbb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99', 'volume_name': 'volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a306cf8a-c335-49e4-af54-405e57fc2b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a306cf8a-c335-49e4-af54-405e57fc2b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e853b3-7949-43c2-a84e-208aef37a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:00 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Volume 3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99', 'volume_size': 1} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100387051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:00Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Creating volume 3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:00 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:00 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 1073741824 Nov 02 10:03:00 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.quota [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Created reservations ['0e82e275-5398-4218-b0ec-2f08ba48f04b', '8322bf53-4216-4f23-9a3c-6f2615649b74', '9ab373d6-5158-4380-ad48-440ff8576f77', '2fc94fcf-5b3f-4c22-8102-89b2ed565619'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:00 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:00 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:00 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 1073741824" returned: 0 in 0.653s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:00 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 Nov 02 10:03:00 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:00 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.619s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:00 devstack cinder-volume[87005]: DEBUG cinder.manager [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Deleted volume successfully. Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-6cefeef6-bb5f-4d5a-b8d2-484790666972 req-cf802ac1-d42b-43bc-bdc6-f6c8fd3e1c99 tempest-VolumesSnapshotsTestJSON-1028497395 None] Lock "cinder-1c4bb539-2c48-40cf-9377-bb544bf8ecaa-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:01 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99" returned: 0 in 0.517s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e853b3-7949-43c2-a84e-208aef37a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a41c3c-8b9c-4f50-8cbc-7475e2a3f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:01 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Volume volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 (3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99): created successfully Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a41c3c-8b9c-4f50-8cbc-7475e2a3f94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (89724310-1119-425d-9557-3281fdc7774f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-59d16848-5be0-47be-9891-16cfbef62426 tempest-VolumesActionsTest-1722549982 None] Created volume successfully. Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-quobyte-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d375580-3845-453a-81cd-c001aae54159]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:02 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 Nov 02 10:03:02 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:02 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99" returned: 0 in 0.512s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:02 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99 Nov 02 10:03:02 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:03 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99" returned: 0 in 0.378s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99" released by "delete_volume" :: held 0.965s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Created reservations ['30381c4a-3960-4481-a3df-ae12de51c1a0', 'd8326393-747f-4963-8038-367f7811048e', '95a017be-6e39-4c17-98c7-249f5f21c05c', '87b1f744-e399-43e2-b059-3a9958b3eaea'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:03 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:03 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:03 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.312s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Deleted volume successfully. Nov 02 10:03:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f82b5ff-211d-42ab-8cee-c3ffe8ef1056 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-3e90a2e1-f9f8-4e9a-b7ab-53943aa3ea99-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (0d9501d8-288a-4a1d-8949-c0d464d4e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc31f67-0e16-4eec-a683-2b3b5fa49c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc31f67-0e16-4eec-a683-2b3b5fa49c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-921845340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52783c66-7c24-4bab-9c32-e8058cec2e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:06Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a709e86f-c2ff-48ad-a471-9db0b18d13c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a709e86f-c2ff-48ad-a471-9db0b18d13c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a557ff-e927-4c25-a78e-f6154e81ec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a557ff-e927-4c25-a78e-f6154e81ec74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52783c66-7c24-4bab-9c32-e8058cec2e11', 'volume_name': 'volume-52783c66-7c24-4bab-9c32-e8058cec2e11', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82698b4a-4eb2-4d44-9027-7a148b7fd06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82698b4a-4eb2-4d44-9027-7a148b7fd06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec033fc5-8868-434a-9430-92b9429e0dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:06 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Volume 52783c66-7c24-4bab-9c32-e8058cec2e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52783c66-7c24-4bab-9c32-e8058cec2e11', 'volume_size': 1} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-921845340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52783c66-7c24-4bab-9c32-e8058cec2e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:06Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Creating volume 52783c66-7c24-4bab-9c32-e8058cec2e11 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:06 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:06 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 1073741824 Nov 02 10:03:06 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:07 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 1073741824" returned: 0 in 1.015s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:07 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 Nov 02 10:03:07 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:07 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11" returned: 0 in 0.359s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec033fc5-8868-434a-9430-92b9429e0dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52783c66-7c24-4bab-9c32-e8058cec2e11', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d48049-92d3-4587-aa39-efd2dd32550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:07 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Volume volume-52783c66-7c24-4bab-9c32-e8058cec2e11 (52783c66-7c24-4bab-9c32-e8058cec2e11): created successfully Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d48049-92d3-4587-aa39-efd2dd32550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (0d9501d8-288a-4a1d-8949-c0d464d4e270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:07 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8a2aaf57-3dbf-45d6-878f-0b1e7eebfaca tempest-VolumesActionsTest-1722549982 None] Created volume successfully. Nov 02 10:03:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-52783c66-7c24-4bab-9c32-e8058cec2e11-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-52783c66-7c24-4bab-9c32-e8058cec2e11-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-quobyte-52783c66-7c24-4bab-9c32-e8058cec2e11" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-52783c66-7c24-4bab-9c32-e8058cec2e11" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:08 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6a1427-96f8-4354-9c1d-22a84ada9e5d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:08 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 Nov 02 10:03:08 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:09 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11" returned: 0 in 0.619s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:09 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11 Nov 02 10:03:09 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:09 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-52783c66-7c24-4bab-9c32-e8058cec2e11" returned: 0 in 0.400s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-52783c66-7c24-4bab-9c32-e8058cec2e11" released by "delete_volume" :: held 1.097s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Created reservations ['42a45fcf-3e15-474c-a79e-a739d3ec1914', '7ce8749b-e27b-4be9-b132-e5a322cd015c', '7d864ac9-f3a7-45de-968f-142890a48b04', '7fb11051-75b6-4834-b8ae-14599df13a43'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:09 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:09 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:10 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.418s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:10 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:10 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Deleted volume successfully. Nov 02 10:03:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec41752e-c6bf-466b-9a8b-60bc97a9b6d6 tempest-VolumesActionsTest-1064120499 None] Lock "cinder-52783c66-7c24-4bab-9c32-e8058cec2e11-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (e9e8c5db-5aab-49da-a1c3-67fe2e679bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d67dcdb-374e-4ae0-b842-ae5f4081e350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d67dcdb-374e-4ae0-b842-ae5f4081e350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189956863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04f8d6c-4784-4955-b2e9-70c3bd3f676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:12Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea778f92-2b21-4032-9f02-bcace2efe406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea778f92-2b21-4032-9f02-bcace2efe406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd07e5c4-e88f-4f54-87ef-01c94cabad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd07e5c4-e88f-4f54-87ef-01c94cabad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04f8d6c-4784-4955-b2e9-70c3bd3f676f', 'volume_name': 'volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85650cf1-dcc5-453a-810c-7877921bf3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85650cf1-dcc5-453a-810c-7877921bf3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0c9115-400f-4139-aca4-2d57661000db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:11 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Volume c04f8d6c-4784-4955-b2e9-70c3bd3f676f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f', 'volume_size': 1} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189956863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04f8d6c-4784-4955-b2e9-70c3bd3f676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:12Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Creating volume c04f8d6c-4784-4955-b2e9-70c3bd3f676f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:11 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:11 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f 1073741824 Nov 02 10:03:11 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:12 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f 1073741824" returned: 0 in 0.623s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:12 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f Nov 02 10:03:12 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:12 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f" returned: 0 in 0.355s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0c9115-400f-4139-aca4-2d57661000db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95ca512-2903-49ff-9d27-7ac1f196006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:12 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Volume volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f (c04f8d6c-4784-4955-b2e9-70c3bd3f676f): created successfully Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95ca512-2903-49ff-9d27-7ac1f196006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (e9e8c5db-5aab-49da-a1c3-67fe2e679bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a4a2a710-1265-40c7-925a-df3b6640c9ef tempest-VolumesActionsTest-1722549982 None] Created volume successfully. Nov 02 10:03:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-c04f8d6c-4784-4955-b2e9-70c3bd3f676f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Lock "cinder-c04f8d6c-4784-4955-b2e9-70c3bd3f676f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-quobyte-c04f8d6c-4784-4955-b2e9-70c3bd3f676f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-c04f8d6c-4784-4955-b2e9-70c3bd3f676f" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:14 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa7040-d817-4ec7-bca9-1830894f6605]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:14 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f Nov 02 10:03:14 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:14 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f" returned: 0 in 0.466s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:14 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f Nov 02 10:03:14 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:15 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c04f8d6c-4784-4955-b2e9-70c3bd3f676f" returned: 0 in 0.486s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-c04f8d6c-4784-4955-b2e9-70c3bd3f676f" released by "delete_volume" :: held 1.044s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Created reservations ['acd98729-9a17-45f6-a5cd-d3593f75babc', 'ee2e35d2-5d03-45b0-8370-d4d603be7657', '17189677-aa0a-4055-98cd-d5dd0937d6a5', 'fb61ef40-ab88-43c6-9a8d-c2b6574f5b06'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:15 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:15 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:15 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.309s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Deleted volume successfully. Nov 02 10:03:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc9b7e00-6420-4f12-9516-787e52c9181c tempest-VolumesActionsTest-1064120499 None] Lock "cinder-c04f8d6c-4784-4955-b2e9-70c3bd3f676f-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:16 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (5bd23d9c-3b3e-464c-946c-d2a3668d72bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791d8a13-1f52-47e5-9c27-adc58bd2d425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791d8a13-1f52-47e5-9c27-adc58bd2d425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-516024861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503fe6c5-2780-47bd-84f2-19f6a9ff6155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:17Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fe220e-258a-4977-bc57-c5c9d08bd007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fe220e-258a-4977-bc57-c5c9d08bd007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaa6c0e-52f9-42ed-82ee-530bc45ad177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaa6c0e-52f9-42ed-82ee-530bc45ad177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503fe6c5-2780-47bd-84f2-19f6a9ff6155', 'volume_name': 'volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cfd6eb-9837-435e-891f-c7141fb514ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cfd6eb-9837-435e-891f-c7141fb514ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f759620-b9e1-4865-85a9-ac30cc11dd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Volume 503fe6c5-2780-47bd-84f2-19f6a9ff6155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155', 'volume_size': 1} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-516024861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503fe6c5-2780-47bd-84f2-19f6a9ff6155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:17Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Creating volume 503fe6c5-2780-47bd-84f2-19f6a9ff6155 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:17 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:17 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 1073741824 Nov 02 10:03:17 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:17 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 1073741824" returned: 0 in 0.640s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:17 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 Nov 02 10:03:17 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:18 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155" returned: 0 in 0.651s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f759620-b9e1-4865-85a9-ac30cc11dd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cf8961-24e8-4ab0-bd9c-78a11407ce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:18 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Volume volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 (503fe6c5-2780-47bd-84f2-19f6a9ff6155): created successfully Nov 02 10:03:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cf8961-24e8-4ab0-bd9c-78a11407ce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (5bd23d9c-3b3e-464c-946c-d2a3668d72bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5a97b45e-aeb5-4d3d-9a59-a0ef3215bae1 tempest-VolumesActionsTest-1722549982 None] Created volume successfully. Nov 02 10:03:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-503fe6c5-2780-47bd-84f2-19f6a9ff6155-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Lock "cinder-503fe6c5-2780-47bd-84f2-19f6a9ff6155-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Acquiring lock "cinder-quobyte-503fe6c5-2780-47bd-84f2-19f6a9ff6155" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-503fe6c5-2780-47bd-84f2-19f6a9ff6155" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:19 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[679c7b42-b850-43ce-b7e0-f44ebedd3140]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:19 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 Nov 02 10:03:19 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:20 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155" returned: 0 in 0.558s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:20 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155 Nov 02 10:03:20 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:20 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-503fe6c5-2780-47bd-84f2-19f6a9ff6155" returned: 0 in 0.643s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Lock "cinder-quobyte-503fe6c5-2780-47bd-84f2-19f6a9ff6155" released by "delete_volume" :: held 1.274s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:20 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Created reservations ['1c713d70-e544-494b-82dc-a5405e2bc387', '6b4cbb6b-72dd-404c-bbe2-b160f67f86f2', '95c58631-2ae3-47a0-982d-e5e7fdb51832', 'e653fb8c-a7f8-4a9c-87a8-bf9bb4a057c0'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:21 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:21 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:21 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.293s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Deleted volume successfully. Nov 02 10:03:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3b3cc18-3dd0-4c2c-858d-8843fead882e tempest-VolumesActionsTest-1064120499 None] Lock "cinder-503fe6c5-2780-47bd-84f2-19f6a9ff6155-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (dc1ef2bc-561b-4450-802a-6f174fda78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b7744d-4610-49c3-a1bb-4b73530c18fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b7744d-4610-49c3-a1bb-4b73530c18fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-674649504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829d975e-5334-41bb-b861-4f6323f9c2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:22Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b37797f-138a-42b7-89da-78f85b7fa2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b37797f-138a-42b7-89da-78f85b7fa2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c2811c-cd4f-4bd3-8d12-cad32e39aad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c2811c-cd4f-4bd3-8d12-cad32e39aad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829d975e-5334-41bb-b861-4f6323f9c2fb', 'volume_name': 'volume-829d975e-5334-41bb-b861-4f6323f9c2fb', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde0c359-1d6c-4753-8681-bf39fc6535fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde0c359-1d6c-4753-8681-bf39fc6535fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fb7bf5-a1a3-41d5-abeb-bd9d8b6f4668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Volume 829d975e-5334-41bb-b861-4f6323f9c2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829d975e-5334-41bb-b861-4f6323f9c2fb', 'volume_size': 1} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-674649504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829d975e-5334-41bb-b861-4f6323f9c2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ba1e1f479e44ea838ce5a20e1e4a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:22Z,use_quota=True,user_id='3b22a770ade94b9aaf18bfd0fb185572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Creating volume 829d975e-5334-41bb-b861-4f6323f9c2fb {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:22 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:22 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb 1073741824 Nov 02 10:03:22 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Acquiring lock "cinder-6e069b17-2593-4558-af6f-629cd48b2f00-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:23 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "cinder-6e069b17-2593-4558-af6f-629cd48b2f00-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb 1073741824" returned: 0 in 0.629s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Acquiring lock "cinder-quobyte-6e069b17-2593-4558-af6f-629cd48b2f00" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "cinder-quobyte-6e069b17-2593-4558-af6f-629cd48b2f00" acquired by "delete_volume" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:23 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb Nov 02 10:03:23 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fe0831-2af7-4261-92e7-9bc480e069df]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:23 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 Nov 02 10:03:23 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:23 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb" returned: 0 in 0.325s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fb7bf5-a1a3-41d5-abeb-bd9d8b6f4668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829d975e-5334-41bb-b861-4f6323f9c2fb', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc7b6ff-77cb-44b4-ae31-606fa2cb8e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:23 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Volume volume-829d975e-5334-41bb-b861-4f6323f9c2fb (829d975e-5334-41bb-b861-4f6323f9c2fb): created successfully Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc7b6ff-77cb-44b4-ae31-606fa2cb8e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Flow 'volume_create_manager' (dc1ef2bc-561b-4450-802a-6f174fda78cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7938fa9a-09f1-45d1-add6-3a2d85ecc469 tempest-VolumesActionsTest-1722549982 None] Created volume successfully. Nov 02 10:03:23 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00" returned: 0 in 0.440s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:23 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00 Nov 02 10:03:23 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:24 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6e069b17-2593-4558-af6f-629cd48b2f00" returned: 0 in 0.296s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "cinder-quobyte-6e069b17-2593-4558-af6f-629cd48b2f00" released by "delete_volume" :: held 0.793s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Created reservations ['a0e107a0-35a9-4b86-ba07-9ee4652fb11b', 'd5c47a49-b363-4f01-8ee8-bd57aa55295f', '8a5c059a-d822-4620-88f0-6e94137a0c38', '68fbdb5f-35a2-4ff0-8178-5f1ecc30f825'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:24 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:24 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5c86d3d0-429f-4ea1-96c6-04c922e810e8 tempest-GroupsTest-1128459131 None] Group tempest-Group1-1518226135: creating Nov 02 10:03:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5c86d3d0-429f-4ea1-96c6-04c922e810e8 tempest-GroupsTest-1128459131 None] Group tempest-Group1-1518226135: created successfully Nov 02 10:03:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5c86d3d0-429f-4ea1-96c6-04c922e810e8 tempest-GroupsTest-1128459131 None] Create group completed successfully. Nov 02 10:03:24 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.406s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Deleted volume successfully. Nov 02 10:03:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-54fc0d74-0d9e-4265-b677-3c3e95681bfa tempest-AttachVolumeShelveTestJSON-21280312 None] Lock "cinder-6e069b17-2593-4558-af6f-629cd48b2f00-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "cinder-829d975e-5334-41bb-b861-4f6323f9c2fb-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-829d975e-5334-41bb-b861-4f6323f9c2fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "cinder-quobyte-829d975e-5334-41bb-b861-4f6323f9c2fb" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-quobyte-829d975e-5334-41bb-b861-4f6323f9c2fb" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fead8657-c2a2-4920-b656-230e6680aee4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:25 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb Nov 02 10:03:25 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4970b6c8-55e0-45d2-a6a6-4c8149864657 tempest-GroupsTest-1128459131 None] Group tempest-Group2-978721972: creating Nov 02 10:03:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4970b6c8-55e0-45d2-a6a6-4c8149864657 tempest-GroupsTest-1128459131 None] Group tempest-Group2-978721972: created successfully Nov 02 10:03:25 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb" returned: 0 in 0.466s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4970b6c8-55e0-45d2-a6a6-4c8149864657 tempest-GroupsTest-1128459131 None] Create group completed successfully. Nov 02 10:03:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:25 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb Nov 02 10:03:25 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:26 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-829d975e-5334-41bb-b861-4f6323f9c2fb" returned: 0 in 0.277s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-quobyte-829d975e-5334-41bb-b861-4f6323f9c2fb" released by "delete_volume" :: held 0.815s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Created reservations ['e8db24bc-5fe4-4850-ba89-9fd3c878b82c', '63db6b21-3f57-432c-9777-d1ef0fdea312', '1c51141d-eba1-4ebd-be47-95762e94e9f8', 'e4641ea8-a269-446e-a9b0-9daf0547a0b2'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:26 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:26 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:26 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.293s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Deleted volume successfully. Nov 02 10:03:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8ef9e012-e644-450a-8597-ab74ebbbc9c2 tempest-VolumesActionsTest-1722549982 None] Lock "cinder-829d975e-5334-41bb-b861-4f6323f9c2fb-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Flow 'volume_create_manager' (5c5a90ef-57d3-4c76-aae2-64e2a4a65a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4311b7-715a-4c07-b27c-6534e5fe4b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4311b7-715a-4c07-b27c-6534e5fe4b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260851442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be9570cd-0858-4ed9-b13d-9a8064f93dc6,host='devstack@QuobyteHD#QuobyteHD',id=e336acca-3443-4528-a4ce-649f5b9c565c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979ac8f14c594fb3b1defa07fa8b99f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:28Z,use_quota=True,user_id='45acea3dd2a64b10b8b66d5c31ffb46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83d222ee-e45c-4933-8544-c70e16b12df5),volume_type_id=83d222ee-e45c-4933-8544-c70e16b12df5)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21a5e74-e4e8-4b24-b3f4-c631bf4b21d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21a5e74-e4e8-4b24-b3f4-c631bf4b21d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f6221-36b4-4921-a7d7-c737ba6140ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f6221-36b4-4921-a7d7-c737ba6140ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e336acca-3443-4528-a4ce-649f5b9c565c', 'volume_name': 'volume-e336acca-3443-4528-a4ce-649f5b9c565c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450e93d2-325d-47f2-9057-45f7658eef77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450e93d2-325d-47f2-9057-45f7658eef77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e64c082-e12b-44f4-b41a-0d9cc5c09efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:27 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Volume e336acca-3443-4528-a4ce-649f5b9c565c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e336acca-3443-4528-a4ce-649f5b9c565c', 'volume_size': 1} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be9570cd-0858-4ed9-b13d-9a8064f93dc6,created_at=2026-11-02T09:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260851442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be9570cd-0858-4ed9-b13d-9a8064f93dc6,host='devstack@QuobyteHD#QuobyteHD',id=e336acca-3443-4528-a4ce-649f5b9c565c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979ac8f14c594fb3b1defa07fa8b99f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:28Z,use_quota=True,user_id='45acea3dd2a64b10b8b66d5c31ffb46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83d222ee-e45c-4933-8544-c70e16b12df5),volume_type_id=83d222ee-e45c-4933-8544-c70e16b12df5)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Creating volume e336acca-3443-4528-a4ce-649f5b9c565c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:27 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:27 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c 1073741824 Nov 02 10:03:27 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:28 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c 1073741824" returned: 0 in 0.516s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:28 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c Nov 02 10:03:28 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:28 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c" returned: 0 in 0.288s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e64c082-e12b-44f4-b41a-0d9cc5c09efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e336acca-3443-4528-a4ce-649f5b9c565c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a85dd53-b5a3-4c1e-81e6-a2518fe2eb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:28 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Volume volume-e336acca-3443-4528-a4ce-649f5b9c565c (e336acca-3443-4528-a4ce-649f5b9c565c): created successfully Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a85dd53-b5a3-4c1e-81e6-a2518fe2eb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Flow 'volume_create_manager' (5c5a90ef-57d3-4c76-aae2-64e2a4a65a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f8ca68d8-6d3d-4e5e-8e45-1b622f5d8dd6 tempest-GroupsTest-1128459131 None] Created volume successfully. Nov 02 10:03:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Acquiring lock "cinder-quobyte-e336acca-3443-4528-a4ce-649f5b9c565c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Lock "cinder-quobyte-e336acca-3443-4528-a4ce-649f5b9c565c" acquired by "delete_volume" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[222571c7-15d6-4f97-a735-00e47b45f0e1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:30 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c Nov 02 10:03:30 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:30 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c" returned: 0 in 0.402s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:30 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c Nov 02 10:03:30 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:31 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e336acca-3443-4528-a4ce-649f5b9c565c" returned: 0 in 0.364s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Lock "cinder-quobyte-e336acca-3443-4528-a4ce-649f5b9c565c" released by "delete_volume" :: held 0.854s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Created reservations ['21b60321-db47-469a-bce3-0463f0abb76e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:31 devstack cinder-volume[87005]: WARNING cinder.quota [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-252038636 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-252038636, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:03:31 devstack cinder-volume[87005]: WARNING cinder.quota [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-252038636 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-252038636, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Created reservations ['5871b35c-b5c8-4023-aa97-9264a00f67fd', '0b35b6e1-27fc-40cc-91cd-2bbf7d5b6b31', 'e1d19211-26b2-4646-92b9-cebee4ceac65', 'cff2eafa-f87c-4996-a55f-80e52daa18b9'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:31 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:31 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Created reservations ['94728846-13a9-41b6-b70f-73913a4b73d1'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:32 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:32 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:32 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.497s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:32 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a6d81f66-4d21-4ad0-880c-7ad45842a274 tempest-GroupsTest-1128459131 None] Delete group completed successfully. Nov 02 10:03:32 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.303s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:32 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:32 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d770c537-4d56-4efb-a2a5-247c8b76c566 tempest-GroupsTest-1128459131 None] Delete group completed successfully. Nov 02 10:03:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2e29e256-2e4a-47f1-99ff-11ad9266abdc tempest-GroupsTest-1128459131 None] Group tempest-GroupsTest-Group-969068969: creating Nov 02 10:03:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-8e60e9d7-b713-4a91-b1ab-90a4a45ea801 req-c54d31b5-1be5-4598-9f8c-e5685052bacd tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-8e60e9d7-b713-4a91-b1ab-90a4a45ea801 req-c54d31b5-1be5-4598-9f8c-e5685052bacd tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-8e60e9d7-b713-4a91-b1ab-90a4a45ea801 req-c54d31b5-1be5-4598-9f8c-e5685052bacd tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2e29e256-2e4a-47f1-99ff-11ad9266abdc tempest-GroupsTest-1128459131 None] Group tempest-GroupsTest-Group-969068969: created successfully Nov 02 10:03:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2e29e256-2e4a-47f1-99ff-11ad9266abdc tempest-GroupsTest-1128459131 None] Create group completed successfully. Nov 02 10:03:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-8e60e9d7-b713-4a91-b1ab-90a4a45ea801 req-c54d31b5-1be5-4598-9f8c-e5685052bacd tempest-ServerActionsTestOtherA-1451225399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecec93d2-561f-48a7-89f9-bcef29146010', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:03:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-8e60e9d7-b713-4a91-b1ab-90a4a45ea801 req-c54d31b5-1be5-4598-9f8c-e5685052bacd tempest-ServerActionsTestOtherA-1451225399 None] attachment_update completed successfully. Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Flow 'volume_create_manager' (ecc9439e-0415-4567-bd67-e8150e753a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5988b42-33ec-43dd-b2dc-7adb860200c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5988b42-33ec-43dd-b2dc-7adb860200c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398894427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df1d914b-dae4-425f-84c5-5844ac09a2f5,host='devstack@QuobyteHD#QuobyteHD',id=48cc562e-6957-4400-a75a-ae1519dde4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979ac8f14c594fb3b1defa07fa8b99f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:36Z,use_quota=True,user_id='45acea3dd2a64b10b8b66d5c31ffb46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca29088d-fa6e-47d6-913a-2703fe486de0),volume_type_id=ca29088d-fa6e-47d6-913a-2703fe486de0)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0961aae-8bae-41de-bb0c-d70483efb429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0961aae-8bae-41de-bb0c-d70483efb429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e40605-99de-453f-baf4-128a6d2b9ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e40605-99de-453f-baf4-128a6d2b9ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cc562e-6957-4400-a75a-ae1519dde4cc', 'volume_name': 'volume-48cc562e-6957-4400-a75a-ae1519dde4cc', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07945b3-bdf0-4fbb-80a8-697f42ed0fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07945b3-bdf0-4fbb-80a8-697f42ed0fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750c567-559c-4f0c-90d6-a903a66372ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Volume 48cc562e-6957-4400-a75a-ae1519dde4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cc562e-6957-4400-a75a-ae1519dde4cc', 'volume_size': 1} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df1d914b-dae4-425f-84c5-5844ac09a2f5,created_at=2026-11-02T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398894427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df1d914b-dae4-425f-84c5-5844ac09a2f5,host='devstack@QuobyteHD#QuobyteHD',id=48cc562e-6957-4400-a75a-ae1519dde4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979ac8f14c594fb3b1defa07fa8b99f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:36Z,use_quota=True,user_id='45acea3dd2a64b10b8b66d5c31ffb46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca29088d-fa6e-47d6-913a-2703fe486de0),volume_type_id=ca29088d-fa6e-47d6-913a-2703fe486de0)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Creating volume 48cc562e-6957-4400-a75a-ae1519dde4cc {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:36 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:36 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc 1073741824 Nov 02 10:03:36 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:36 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc 1073741824" returned: 0 in 0.508s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:36 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc Nov 02 10:03:36 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:36 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc" returned: 0 in 0.343s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750c567-559c-4f0c-90d6-a903a66372ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cc562e-6957-4400-a75a-ae1519dde4cc', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e712605f-7e4e-4f1c-88a4-b8aed511cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Volume volume-48cc562e-6957-4400-a75a-ae1519dde4cc (48cc562e-6957-4400-a75a-ae1519dde4cc): created successfully Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e712605f-7e4e-4f1c-88a4-b8aed511cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Flow 'volume_create_manager' (ecc9439e-0415-4567-bd67-e8150e753a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:37 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-59c276dd-9dfd-4d4a-bfdb-11998cdd9a2e tempest-GroupsTest-1128459131 None] Created volume successfully. Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Flow 'volume_create_manager' (766c79c1-ad4f-4ee4-8d69-14ce0bb29943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7064c495-f3a7-4452-9071-1a1fff25aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7064c495-f3a7-4452-9071-1a1fff25aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1377653187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df1d914b-dae4-425f-84c5-5844ac09a2f5,host='devstack@QuobyteHD#QuobyteHD',id=023f6947-311d-483a-bfb1-928f0a9ef2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979ac8f14c594fb3b1defa07fa8b99f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:38Z,use_quota=True,user_id='45acea3dd2a64b10b8b66d5c31ffb46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca29088d-fa6e-47d6-913a-2703fe486de0),volume_type_id=ca29088d-fa6e-47d6-913a-2703fe486de0)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca60eba-9675-48da-843c-d4930f787bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca60eba-9675-48da-843c-d4930f787bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695bd64a-7a27-42a3-9782-8a99d462190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695bd64a-7a27-42a3-9782-8a99d462190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023f6947-311d-483a-bfb1-928f0a9ef2c5', 'volume_name': 'volume-023f6947-311d-483a-bfb1-928f0a9ef2c5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5c8585-bced-4b8e-b7c9-17f2c5dc8cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5c8585-bced-4b8e-b7c9-17f2c5dc8cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7c76f1-d1fd-4ca4-b322-6f7b5a6f2818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:37 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Volume 023f6947-311d-483a-bfb1-928f0a9ef2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023f6947-311d-483a-bfb1-928f0a9ef2c5', 'volume_size': 1} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df1d914b-dae4-425f-84c5-5844ac09a2f5,created_at=2026-11-02T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1377653187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df1d914b-dae4-425f-84c5-5844ac09a2f5,host='devstack@QuobyteHD#QuobyteHD',id=023f6947-311d-483a-bfb1-928f0a9ef2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979ac8f14c594fb3b1defa07fa8b99f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:38Z,use_quota=True,user_id='45acea3dd2a64b10b8b66d5c31ffb46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca29088d-fa6e-47d6-913a-2703fe486de0),volume_type_id=ca29088d-fa6e-47d6-913a-2703fe486de0)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Creating volume 023f6947-311d-483a-bfb1-928f0a9ef2c5 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:37 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:37 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 1073741824 Nov 02 10:03:37 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:38 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 1073741824" returned: 0 in 0.595s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:38 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 Nov 02 10:03:38 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:38 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5" returned: 0 in 0.399s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7c76f1-d1fd-4ca4-b322-6f7b5a6f2818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023f6947-311d-483a-bfb1-928f0a9ef2c5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903f6333-3aa6-4c2d-973d-e26e3f5eb61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Volume volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 (023f6947-311d-483a-bfb1-928f0a9ef2c5): created successfully Nov 02 10:03:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903f6333-3aa6-4c2d-973d-e26e3f5eb61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Flow 'volume_create_manager' (766c79c1-ad4f-4ee4-8d69-14ce0bb29943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c99dec68-4300-44fd-b48c-439dabf82369 tempest-GroupsTest-1128459131 None] Created volume successfully. Nov 02 10:03:40 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-b82eb906-b363-4c9e-8920-3bd3aeac37bc req-aaee8bf0-7e45-4e86-be40-d5f97cd3073c tempest-ServerActionsTestOtherA-1451225399 None] Terminate volume connection completed successfully. Nov 02 10:03:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-b82eb906-b363-4c9e-8920-3bd3aeac37bc req-aaee8bf0-7e45-4e86-be40-d5f97cd3073c tempest-ServerActionsTestOtherA-1451225399 None] Deleting attachment ecec93d2-561f-48a7-89f9-bcef29146010. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:03:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-de58afcc-1626-4c56-8f1f-eaac36fd113c tempest-GroupsTest-1128459131 None] Update group completed successfully. Nov 02 10:03:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-b82eb906-b363-4c9e-8920-3bd3aeac37bc req-895885cb-51b1-4407-a220-0d1b17f80bcb tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-b82eb906-b363-4c9e-8920-3bd3aeac37bc req-895885cb-51b1-4407-a220-0d1b17f80bcb tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-b82eb906-b363-4c9e-8920-3bd3aeac37bc req-895885cb-51b1-4407-a220-0d1b17f80bcb tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-b82eb906-b363-4c9e-8920-3bd3aeac37bc req-895885cb-51b1-4407-a220-0d1b17f80bcb tempest-ServerActionsTestOtherA-1451225399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0463701d-f925-4dd1-8f84-f17ceec13ac8', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:03:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-b82eb906-b363-4c9e-8920-3bd3aeac37bc req-895885cb-51b1-4407-a220-0d1b17f80bcb tempest-ServerActionsTestOtherA-1451225399 None] attachment_update completed successfully. Nov 02 10:03:42 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f0d5596c-89b0-4b86-8bba-6983d9203e1a tempest-GroupsTest-1128459131 None] Update group completed successfully. Nov 02 10:03:44 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=132,cinder:SELECT=115,cinder:DELETE=14,cinder:INSERT=24 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:44 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=116,cinder:INSERT=32,cinder:UPDATE=125,cinder:DELETE=6 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Acquiring lock "cinder-quobyte-023f6947-311d-483a-bfb1-928f0a9ef2c5" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Lock "cinder-quobyte-023f6947-311d-483a-bfb1-928f0a9ef2c5" acquired by "delete_volume" :: waited 0.050s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:44 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8483e-9c9b-486c-9f37-1c4952892bac]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:45 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 Nov 02 10:03:45 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:45 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5" returned: 0 in 1.021s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:46 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5 Nov 02 10:03:46 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:46 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-023f6947-311d-483a-bfb1-928f0a9ef2c5" returned: 0 in 0.814s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Lock "cinder-quobyte-023f6947-311d-483a-bfb1-928f0a9ef2c5" released by "delete_volume" :: held 1.970s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Acquiring lock "cinder-quobyte-48cc562e-6957-4400-a75a-ae1519dde4cc" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Lock "cinder-quobyte-48cc562e-6957-4400-a75a-ae1519dde4cc" acquired by "delete_volume" :: waited 0.039s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0f903-aa66-4912-818a-4b7c46907a6f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:47 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc Nov 02 10:03:47 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:47 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc" returned: 0 in 0.692s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:47 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc Nov 02 10:03:47 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:48 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cc562e-6957-4400-a75a-ae1519dde4cc" returned: 0 in 0.359s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Lock "cinder-quobyte-48cc562e-6957-4400-a75a-ae1519dde4cc" released by "delete_volume" :: held 1.163s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Created reservations ['36f0ed79-f11e-49f0-9a5e-3d1155e5b20e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:48 devstack cinder-volume[87005]: WARNING cinder.quota [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-220889628 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-220889628, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:03:48 devstack cinder-volume[87005]: WARNING cinder.quota [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-220889628 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-220889628, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Created reservations ['b129a32c-4ffd-4b98-8a75-fff9d507fe53', 'd1117693-57cc-4c48-8103-9fba1024e393', '207a1518-300c-4f20-bf99-62f23b0b94fb', 'f6e13fef-3405-42aa-a488-540e5070e1a5'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Created reservations ['330b0135-8902-48e8-adf6-bed4512888b1', 'ca1c8771-ff76-4575-ad8c-9d9d2913d777', '44d1faad-3b64-4df4-b42d-1ce23b01f1db', 'bc2156ce-2e6a-428e-8ecc-ef64ef599a1b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:48 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:48 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:48 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:03:48 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:49 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.581s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-52c79b7a-1bce-45aa-9216-ade0d0f907ea tempest-GroupsTest-1128459131 None] Delete group completed successfully. Nov 02 10:03:49 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.684s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:03:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 8 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:03:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Flow 'volume_create_manager' (67e76179-8478-4b8e-9ae0-1b41730b7a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a6e79a-8f80-44fc-a0ec-dbc661bdf953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a6e79a-8f80-44fc-a0ec-dbc661bdf953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1961371323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69077dd0-6a19-4d96-830d-0c6628b4d6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='748b164de7ec4963a37412e4ec2f2738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:54Z,use_quota=True,user_id='4581c56644614afc862299996d2bd900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd8ee85-2e82-4a0e-8ac5-4bf94fa47881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd8ee85-2e82-4a0e-8ac5-4bf94fa47881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fee1f8-89d7-47da-a64d-7b787138b82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fee1f8-89d7-47da-a64d-7b787138b82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69077dd0-6a19-4d96-830d-0c6628b4d6e0', 'volume_name': 'volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babf6ff7-19d6-46a8-a999-46355e0ca6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babf6ff7-19d6-46a8-a999-46355e0ca6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338b91ce-3687-439f-b25d-2fe46e84aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:54 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Volume 69077dd0-6a19-4d96-830d-0c6628b4d6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0', 'volume_size': 1} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1961371323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69077dd0-6a19-4d96-830d-0c6628b4d6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='748b164de7ec4963a37412e4ec2f2738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:54Z,use_quota=True,user_id='4581c56644614afc862299996d2bd900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Creating volume 69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:54 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:03:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:54 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 1073741824 Nov 02 10:03:54 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:55 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 1073741824" returned: 0 in 0.721s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:55 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 Nov 02 10:03:55 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:55 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0" returned: 0 in 0.341s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338b91ce-3687-439f-b25d-2fe46e84aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106910ed-61b3-42f3-8bcd-bb1fbc17a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:55 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Volume volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 (69077dd0-6a19-4d96-830d-0c6628b4d6e0): created successfully Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106910ed-61b3-42f3-8bcd-bb1fbc17a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Flow 'volume_create_manager' (67e76179-8478-4b8e-9ae0-1b41730b7a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4a92052b-5966-48d6-a8e2-926d963f31b8 tempest-SnapshotMetadataTestJSON-1078116042 None] Created volume successfully. Nov 02 10:03:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Creating offline snapshot 71de2451-1023-4d30-863e-d7e282211fcc of volume 69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:03:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4cbdce-8de0-42b7-b49b-f248f8df738b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:56 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 Nov 02 10:03:56 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:57 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0" returned: 0 in 0.578s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:57 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc 1G Nov 02 10:03:57 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:57 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc 1G" returned: 0 in 0.647s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:58 devstack sudo[92316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc Nov 02 10:03:58 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:58 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc" returned: 0 in 0.533s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:58 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc is being set with open permissions: ugo+rw Nov 02 10:03:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:58 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc Nov 02 10:03:58 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:59 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc" returned: 0 in 0.502s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:59 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.info Nov 02 10:03:59 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:59 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.info" returned: 0 in 0.346s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:59 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.info is being set with open permissions: ugo+rw Nov 02 10:03:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:59 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.info Nov 02 10:03:59 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:59 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.info" returned: 0 in 0.315s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.066s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:59 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e1573eed-64b8-494d-bee9-1ce584a3101a tempest-SnapshotMetadataTestJSON-1078116042 None] Create snapshot completed successfully Nov 02 10:04:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "cinder-71de2451-1023-4d30-863e-d7e282211fcc-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-71de2451-1023-4d30-863e-d7e282211fcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "cinder-quobyte-69077dd0-6a19-4d96-830d-0c6628b4d6e0" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-quobyte-69077dd0-6a19-4d96-830d-0c6628b4d6e0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "cinder-quobyte-71de2451-1023-4d30-863e-d7e282211fcc" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-quobyte-71de2451-1023-4d30-863e-d7e282211fcc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Deleting offline snapshot 71de2451-1023-4d30-863e-d7e282211fcc of volume 69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] snapshot_file for this snap is: volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15a74f7-d357-4d2e-93f3-0bfd862ad198]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:01 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc Nov 02 10:04:01 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:01 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc" returned: 0 in 0.515s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3337e7-b256-4e10-b9b1-36e30413f21b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:01 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 Nov 02 10:04:01 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:02 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0" returned: 0 in 0.597s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:02 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc Nov 02 10:04:02 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:02 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc" returned: 0 in 0.553s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:02 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc Nov 02 10:04:02 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:03 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0.71de2451-1023-4d30-863e-d7e282211fcc" returned: 0 in 0.427s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-quobyte-71de2451-1023-4d30-863e-d7e282211fcc" released by "_delete_snapshot" :: held 2.290s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-quobyte-69077dd0-6a19-4d96-830d-0c6628b4d6e0" released by "delete_snapshot" :: held 2.319s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:03 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Created reservations ['59dc5e9c-c9c4-4ff1-8d4f-e1833edf6399', '8cbf067c-4685-4895-97a9-185a81b754dc', '0e21d4f1-c00a-4580-b45a-95c8023e443c', 'e50330ab-3f7f-49a0-b5de-7c57be3f6ec5'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Delete snapshot completed successfully. Nov 02 10:04:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-40dc15f5-e9e5-4b22-bebd-c2880be6f24f tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-71de2451-1023-4d30-863e-d7e282211fcc-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "cinder-69077dd0-6a19-4d96-830d-0c6628b4d6e0-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-69077dd0-6a19-4d96-830d-0c6628b4d6e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "cinder-quobyte-69077dd0-6a19-4d96-830d-0c6628b4d6e0" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-quobyte-69077dd0-6a19-4d96-830d-0c6628b4d6e0" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:04 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0ff3d-cc05-407b-9b01-a309e88939b9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:04 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 Nov 02 10:04:04 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:05 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0" returned: 0 in 0.499s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:05 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0 Nov 02 10:04:05 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:05 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69077dd0-6a19-4d96-830d-0c6628b4d6e0" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-quobyte-69077dd0-6a19-4d96-830d-0c6628b4d6e0" released by "delete_volume" :: held 0.944s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Created reservations ['6313cbd0-2a50-4d3f-afe6-c056ffe56a27', 'a5d71f42-984d-4036-bcb1-2563ae92a033', '33a03ca8-b4db-4132-aea6-89fb3dcd1c50', '6d00d77f-54ea-40b2-ac0d-3da8699a25e6'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:05 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:04:05 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:05 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:05 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Deleted volume successfully. Nov 02 10:04:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9bdbdbb2-0dda-4bfc-9942-3c58ab69f6c0 tempest-SnapshotMetadataTestJSON-1078116042 None] Lock "cinder-69077dd0-6a19-4d96-830d-0c6628b4d6e0-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-4ae04803-25da-4207-aa0c-73e74c88510a req-db3852e8-9e5e-466e-951a-3221c0836f45 tempest-ServerActionsTestOtherA-1451225399 None] Terminate volume connection completed successfully. Nov 02 10:04:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-4ae04803-25da-4207-aa0c-73e74c88510a req-db3852e8-9e5e-466e-951a-3221c0836f45 tempest-ServerActionsTestOtherA-1451225399 None] Deleting attachment 0463701d-f925-4dd1-8f84-f17ceec13ac8. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Flow 'volume_create_manager' (cf99716f-f451-471e-bdec-927ceb79b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690dd3db-1fdb-4845-8bbb-dca9477f5455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690dd3db-1fdb-4845-8bbb-dca9477f5455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-859807325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c366c17-f1e8-4ba1-81f0-c7e109dafda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16307e62e599425fa2c57275ad42d7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:14Z,use_quota=True,user_id='b7f8abb2fc2d43c389525c1001181b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509494b8-82e0-4722-bd79-a9173e252421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509494b8-82e0-4722-bd79-a9173e252421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af81ab-0eb2-4723-90d9-7bc755d2507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af81ab-0eb2-4723-90d9-7bc755d2507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c366c17-f1e8-4ba1-81f0-c7e109dafda5', 'volume_name': 'volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcca3938-4c36-4bfb-b761-bb7cafc00cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcca3938-4c36-4bfb-b761-bb7cafc00cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d918da77-bf17-422f-aed7-c1117dbd52c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5', 'volume_size': 1} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-859807325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c366c17-f1e8-4ba1-81f0-c7e109dafda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16307e62e599425fa2c57275ad42d7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:14Z,use_quota=True,user_id='b7f8abb2fc2d43c389525c1001181b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Creating volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:13 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:04:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:14 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 1073741824 Nov 02 10:04:14 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:15 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 1073741824" returned: 0 in 1.138s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:15 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 Nov 02 10:04:15 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:15 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" returned: 0 in 0.457s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d918da77-bf17-422f-aed7-c1117dbd52c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b04383-19c2-4611-857b-a16139885af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:15 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Volume volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 (0c366c17-f1e8-4ba1-81f0-c7e109dafda5): created successfully Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b04383-19c2-4611-857b-a16139885af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Flow 'volume_create_manager' (cf99716f-f451-471e-bdec-927ceb79b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e3ce272f-bd73-4176-82c9-55194326a657 tempest-SnapshotsActionsTest-1985146038 None] Created volume successfully. Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Creating offline snapshot b7ae4774-33ec-45e7-826e-bf8b2a264c45 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae6898f-30b1-47b9-94d3-02372700fa10]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:17 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 Nov 02 10:04:17 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Flow 'volume_create_manager' (896b31f0-81e0-4c7b-b21f-00ec7c4d67aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:17 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8668d2e5-26f8-47bf-8977-566e9f21721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" returned: 0 in 0.410s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:17 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 1G Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8668d2e5-26f8-47bf-8977-566e9f21721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1801250207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980de487-4283-416a-9696-32c6a39268b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf95ae4d704845b535950a33c807ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:18Z,use_quota=True,user_id='9ec2f944c6fe46728af61d447012d0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf13376-d7b7-4511-ba2d-a4ce86324333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf13376-d7b7-4511-ba2d-a4ce86324333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993a62ef-d724-4ef1-94b7-a6c2caebece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993a62ef-d724-4ef1-94b7-a6c2caebece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980de487-4283-416a-9696-32c6a39268b1', 'volume_name': 'volume-980de487-4283-416a-9696-32c6a39268b1', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b679842d-4e9d-4f17-8e04-98fd1d7677aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b679842d-4e9d-4f17-8e04-98fd1d7677aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41505d34-b9b0-44cb-a130-8418f344fb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Volume 980de487-4283-416a-9696-32c6a39268b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980de487-4283-416a-9696-32c6a39268b1', 'volume_size': 1} Nov 02 10:04:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:18 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 1G" returned: 0 in 0.522s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:18 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:18 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:18 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.388s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:18 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 is being set with open permissions: ugo+rw Nov 02 10:04:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:18 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:18 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:18 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.275s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:19 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.info Nov 02 10:04:19 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:19 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.info" returned: 0 in 0.337s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:19 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.info is being set with open permissions: ugo+rw Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:19 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.info Nov 02 10:04:19 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:19 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.info" returned: 0 in 0.266s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1801250207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980de487-4283-416a-9696-32c6a39268b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf95ae4d704845b535950a33c807ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:18Z,use_quota=True,user_id='9ec2f944c6fe46728af61d447012d0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Creating volume 980de487-4283-416a-9696-32c6a39268b1 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:19 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:04:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:19 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 1073741824 Nov 02 10:04:19 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-22cfe17a-fdba-4ab9-82cf-00b0abb3e90b tempest-SnapshotsActionsTest-1985146038 None] Create snapshot completed successfully Nov 02 10:04:20 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 1073741824" returned: 0 in 0.505s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:20 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 Nov 02 10:04:20 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:20 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1" returned: 0 in 0.307s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41505d34-b9b0-44cb-a130-8418f344fb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980de487-4283-416a-9696-32c6a39268b1', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb324fb-c737-4c7c-b0fe-d006c2580431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:20 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Volume volume-980de487-4283-416a-9696-32c6a39268b1 (980de487-4283-416a-9696-32c6a39268b1): created successfully Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb324fb-c737-4c7c-b0fe-d006c2580431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Flow 'volume_create_manager' (896b31f0-81e0-4c7b-b21f-00ec7c4d67aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4b8f5ea8-6b3e-495b-80ce-54ec91682871 tempest-VolumesTransfersTest-310999393 None] Created volume successfully. Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Flow 'volume_create_manager' (2cdeccec-d042-4cf5-839f-87c56ab1a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6142923-b518-4432-bedf-a53208f1532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6142923-b518-4432-bedf-a53208f1532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1877427651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252207df-c64f-40fe-9b32-cd92c91af301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db109d18250c4768970368c3a2cae584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:21Z,use_quota=True,user_id='56d2d6ea0f3e4064b0f9256c4ae01c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa5e540-55bb-4062-9753-9b941b00d9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa5e540-55bb-4062-9753-9b941b00d9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff554b2-16d3-4aff-bf99-2067590473d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Creating offline snapshot 4b97519b-3ffa-430c-9096-f9a4f18dbe0d of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fdd2bb-95ed-4e51-a108-666f6dc1d4bc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:21 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:21 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c7e902de-ee2f-42ea-a84b-799b15754be1 tempest-VolumesTransfersTest-118858999 None] Transfer volume completed successfully. Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff554b2-16d3-4aff-bf99-2067590473d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '252207df-c64f-40fe-9b32-cd92c91af301', 'volume_name': 'volume-252207df-c64f-40fe-9b32-cd92c91af301', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf64d86-fa50-4a0f-b10a-d312faa46f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf64d86-fa50-4a0f-b10a-d312faa46f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b675a37a-347d-4df9-9af3-db5d6b6398c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Volume 252207df-c64f-40fe-9b32-cd92c91af301: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-252207df-c64f-40fe-9b32-cd92c91af301', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Trying to clone 252207df-c64f-40fe-9b32-cd92c91af301 from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:04:22 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.760s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:22 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d 1G Nov 02 10:04:22 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:04:22 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13d9c61-f850-4c6b-8d4b-aa47bad056d5]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:22 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD Nov 02 10:04:22 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Acquiring lock "cinder-980de487-4283-416a-9696-32c6a39268b1-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-980de487-4283-416a-9696-32c6a39268b1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Acquiring lock "cinder-quobyte-980de487-4283-416a-9696-32c6a39268b1" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-quobyte-980de487-4283-416a-9696-32c6a39268b1" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[300120de-6219-44e5-8b11-72a732e82f92]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d 1G" returned: 0 in 0.648s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d Nov 02 10:04:23 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 Nov 02 10:04:23 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 is fetched for user 56d2d6ea0f3e4064b0f9256c4ae01c96. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25c4162-85f8-48a2-a9f8-57ff3e543654]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD Nov 02 10:04:23 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d" returned: 0 in 0.367s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d is being set with open permissions: ugo+rw Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d Nov 02 10:04:23 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1" returned: 0 in 0.498s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1 Nov 02 10:04:23 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:23 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d" returned: 0 in 0.307s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1877427651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252207df-c64f-40fe-9b32-cd92c91af301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db109d18250c4768970368c3a2cae584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:21Z,use_quota=True,user_id='56d2d6ea0f3e4064b0f9256c4ae01c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Creating volume 252207df-c64f-40fe-9b32-cd92c91af301 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:23 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 1073741824 Nov 02 10:04:23 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-980de487-4283-416a-9696-32c6a39268b1" returned: 0 in 0.297s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fd233154-f773-49ed-b36a-70ff6977d84e tempest-SnapshotsActionsTest-1985146038 None] Create snapshot completed successfully Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-quobyte-980de487-4283-416a-9696-32c6a39268b1" released by "delete_volume" :: held 0.852s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Created reservations ['5197cf7a-7b83-48fc-b4a0-6125c81c481f', 'e27b735e-14f0-4e15-be4d-420fe4cc7f3c', 'faa600e1-b71a-47d6-b210-4537f3f667b8', '76e8686c-b4d2-4981-85d5-50975a05b33e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:24 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:04:24 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:24 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.304s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Deleted volume successfully. Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-65cbefc9-b4b0-4cb6-97f4-d231508565d4 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-980de487-4283-416a-9696-32c6a39268b1-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:24 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 1073741824" returned: 0 in 0.628s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:24 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 Nov 02 10:04:24 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:24 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301" returned: 0 in 0.330s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Flow 'volume_create_manager' (2a021b85-e335-4a10-b3dc-f436c4d30e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328c71de-ddd9-4052-948e-aeefc012356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-4b97519b-3ffa-430c-9096-f9a4f18dbe0d-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Attempting download of 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume 252207df-c64f-40fe-9b32-cd92c91af301. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328c71de-ddd9-4052-948e-aeefc012356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1562721054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf95ae4d704845b535950a33c807ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:25Z,use_quota=True,user_id='9ec2f944c6fe46728af61d447012d0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdc0e4c-5f45-4dda-918c-73e37fea90a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdc0e4c-5f45-4dda-918c-73e37fea90a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02163e13-eaf8-4387-ad9f-539fac0806bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02163e13-eaf8-4387-ad9f-539fac0806bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4', 'volume_name': 'volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e2e409-df3f-48e5-a17c-290d6bbad934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e2e409-df3f-48e5-a17c-290d6bbad934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed7e31b-b657-406d-8c44-b9a1f146841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Volume 139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4', 'volume_size': 1} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1562721054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf95ae4d704845b535950a33c807ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:25Z,use_quota=True,user_id='9ec2f944c6fe46728af61d447012d0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Creating volume 139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:24 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:04:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-4b97519b-3ffa-430c-9096-f9a4f18dbe0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.115s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:25 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 1073741824 Nov 02 10:04:25 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-4b97519b-3ffa-430c-9096-f9a4f18dbe0d" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-4b97519b-3ffa-430c-9096-f9a4f18dbe0d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Deleting offline snapshot 4b97519b-3ffa-430c-9096-f9a4f18dbe0d of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] snapshot_file for this snap is: volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95eb94-f443-47b1-b162-5a49e82e558a]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_fcvze98y {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[61231ecd-2f09-429d-a720-ad009900bdd1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_fcvze98y Nov 02 10:04:25 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:25 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d Nov 02 10:04:25 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:25 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_fcvze98y" returned: 0 in 0.343s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_fcvze98y {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 1073741824" returned: 0 in 0.549s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 Nov 02 10:04:25 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:25 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_fcvze98y Nov 02 10:04:25 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:25 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d" returned: 0 in 0.502s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69a1909-b38c-4568-927b-8efa0cec3477]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:25 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:25 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_fcvze98y" returned: 1 in 0.392s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_fcvze98y' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[359de001-9a58-422e-83b0-309b27b5b491]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4" returned: 0 in 0.296s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed7e31b-b657-406d-8c44-b9a1f146841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7dac0cf-d26a-4e05-84d3-38bbf8a5d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Volume volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 (139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4): created successfully Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7dac0cf-d26a-4e05-84d3-38bbf8a5d648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Flow 'volume_create_manager' (2a021b85-e335-4a10-b3dc-f436c4d30e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6fa12d7f-7e29-44a2-8365-f0b3f5d59f9e tempest-VolumesTransfersTest-310999393 None] Created volume successfully. Nov 02 10:04:25 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD Nov 02 10:04:25 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:26 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.443s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:26 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d Nov 02 10:04:26 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:26 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] 4e759a38-67b9-4ba7-b77d-917ff16305f2 was qcow2, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:26 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 Nov 02 10:04:26 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:26 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d" returned: 0 in 0.388s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:26 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d Nov 02 10:04:26 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:26 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.4b97519b-3ffa-430c-9096-f9a4f18dbe0d" returned: 0 in 0.262s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-4b97519b-3ffa-430c-9096-f9a4f18dbe0d" released by "_delete_snapshot" :: held 1.739s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" released by "delete_snapshot" :: held 1.779s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:26 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Created reservations ['afb988bd-a011-4b5c-86f7-e90a1975d441', 'cd81a235-4215-4e36-9444-d05a080b3adc', '74deaf02-d789-4edb-8680-004f062a7352', 'ae6d1883-887d-4901-a93f-fda4780df26c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Delete snapshot completed successfully. Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-de81ed47-9f88-40ed-b7b6-ceda8d27a1a5 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-4b97519b-3ffa-430c-9096-f9a4f18dbe0d-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Acquiring lock "cinder-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Acquiring lock "cinder-quobyte-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-quobyte-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f721f7-f85c-48d2-97bd-e79d72a1cf70]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Creating offline snapshot 32d19955-e995-41c3-8fa6-dc15c0ca6190 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:04:27 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 Nov 02 10:04:27 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f748934-e05e-4e9b-a5df-f84d426b87ee]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:27 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:27 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:27 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4" returned: 0 in 0.468s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:27 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4 Nov 02 10:04:27 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:28 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.521s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:28 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4" returned: 0 in 0.279s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:28 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 1G Nov 02 10:04:28 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-quobyte-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4" released by "delete_volume" :: held 0.815s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Created reservations ['8c8c2a87-d073-4aef-8637-9e0c1bda98ad', '223ca423-5b1e-4cf3-8e5e-c58ebacd7fd1', '2012dddc-c156-4877-8cf1-5c69b61acc3e', '6581806d-c6ef-4d91-abd4-a8ff68a2be47'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:28 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:04:28 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:28 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301" returned: 0 in 2.380s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_ij_ou1u9devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:04:28 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Converted 112.00 MB image at 47.04 MB/s Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:28 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 1G Nov 02 10:04:28 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:28 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.311s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Deleted volume successfully. Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a63e50d3-19ed-4f0e-906f-9bd980780fc7 tempest-VolumesTransfersTest-218597316 None] Lock "cinder-139efd7a-2bb6-4f9c-a35d-ba27d9b6f5a4-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:28 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 1G" returned: 0 in 0.604s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:28 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 Nov 02 10:04:28 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:29 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 1G" returned: 0 in 0.447s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Downloaded image 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume 252207df-c64f-40fe-9b32-cd92c91af301 successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 for user 56d2d6ea0f3e4064b0f9256c4ae01c96 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Marking volume 252207df-c64f-40fe-9b32-cd92c91af301 as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Copying metadata from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 to 252207df-c64f-40fe-9b32-cd92c91af301. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Creating volume glance metadata for volume 252207df-c64f-40fe-9b32-cd92c91af301 backed by image 4e759a38-67b9-4ba7-b77d-917ff16305f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b675a37a-347d-4df9-9af3-db5d6b6398c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252207df-c64f-40fe-9b32-cd92c91af301', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:29 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fad48a-7561-45d0-aaee-7aac39c179dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190" returned: 0 in 0.493s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:29 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 is being set with open permissions: ugo+rw Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Volume volume-252207df-c64f-40fe-9b32-cd92c91af301 (252207df-c64f-40fe-9b32-cd92c91af301): created successfully Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fad48a-7561-45d0-aaee-7aac39c179dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:29 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 Nov 02 10:04:29 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Flow 'volume_create_manager' (2cdeccec-d042-4cf5-839f-87c56ab1a986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-669c0744-f657-4eb1-8565-6ea009608747 tempest-ServerActionsTestOtherA-1451225399 None] Created volume successfully. Nov 02 10:04:29 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190" returned: 0 in 0.352s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c9be72f2-e972-4ab9-b917-e700afdb76a4 tempest-SnapshotsActionsTest-1985146038 None] Create snapshot completed successfully Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-32d19955-e995-41c3-8fa6-dc15c0ca6190-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-32d19955-e995-41c3-8fa6-dc15c0ca6190-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-32d19955-e995-41c3-8fa6-dc15c0ca6190" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-32d19955-e995-41c3-8fa6-dc15c0ca6190" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Deleting offline snapshot 32d19955-e995-41c3-8fa6-dc15c0ca6190 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] snapshot_file for this snap is: volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:31 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f234a75e-47f2-42f8-81ef-275f7f116701]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:31 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 Nov 02 10:04:31 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:31 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190" returned: 0 in 0.543s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:31 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e131c5-cc38-4b3f-91c1-9ffdd96538ca]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:31 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:31 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:32 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.483s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:32 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 Nov 02 10:04:32 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:32 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190" returned: 0 in 0.497s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:32 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190 Nov 02 10:04:32 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:32 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.32d19955-e995-41c3-8fa6-dc15c0ca6190" returned: 0 in 0.358s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-32d19955-e995-41c3-8fa6-dc15c0ca6190" released by "_delete_snapshot" :: held 2.098s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" released by "delete_snapshot" :: held 2.142s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Created reservations ['c2ca571f-8397-42ed-bc0f-8375bde5cfb8', 'bf7eaf90-eaf8-4146-8c6b-6c66bd240200', '2384528b-1b20-4752-9dc9-b3387f6ea360', '80396689-78db-4f9b-bfa9-341a5ee6746f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Delete snapshot completed successfully. Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7b4aaf55-6d1e-4cd4-8bf4-07c992987f83 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-32d19955-e995-41c3-8fa6-dc15c0ca6190-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-990cce9d-9eb9-4c62-a21a-dd86cc77c14c req-fcb21304-0bb4-43f6-814d-a91e0708e1bf tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-990cce9d-9eb9-4c62-a21a-dd86cc77c14c req-fcb21304-0bb4-43f6-814d-a91e0708e1bf tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-990cce9d-9eb9-4c62-a21a-dd86cc77c14c req-fcb21304-0bb4-43f6-814d-a91e0708e1bf tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-990cce9d-9eb9-4c62-a21a-dd86cc77c14c req-fcb21304-0bb4-43f6-814d-a91e0708e1bf tempest-ServerActionsTestOtherA-1451225399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-252207df-c64f-40fe-9b32-cd92c91af301', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdaef088-a5c6-4c2c-8564-41fa8a7ec38e', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:04:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-990cce9d-9eb9-4c62-a21a-dd86cc77c14c req-fcb21304-0bb4-43f6-814d-a91e0708e1bf tempest-ServerActionsTestOtherA-1451225399 None] attachment_update completed successfully. Nov 02 10:04:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Creating offline snapshot ca983c0d-6235-4001-a0b2-b30f59b36663 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:04:34 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2bf8ce-f196-42de-9888-29bcf4011c88]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:34 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:34 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:35 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.518s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:35 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 1G Nov 02 10:04:35 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:36 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 1G" returned: 0 in 0.798s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:36 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 Nov 02 10:04:36 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:36 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Flow 'volume_create_manager' (93e6097a-8d87-42df-9b24-9afd6cdf7633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3ed159-8d8e-47cf-8451-f761d0101804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663" returned: 0 in 0.468s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:36 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 is being set with open permissions: ugo+rw Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3ed159-8d8e-47cf-8451-f761d0101804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-918327725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4a7a29-4a27-4675-8ae6-726bd2668a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24c55bd39b4cf68d51703a36c505b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:36Z,use_quota=True,user_id='439062614d054432b4418ff877280425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c023cbeb-ba79-40db-b691-1ad2ad871898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c023cbeb-ba79-40db-b691-1ad2ad871898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d1113d-d5e7-4400-b43a-3c920efc76cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d1113d-d5e7-4400-b43a-3c920efc76cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4a7a29-4a27-4675-8ae6-726bd2668a61', 'volume_name': 'volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f1fa2b-c327-4c62-affa-5c020b363710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f1fa2b-c327-4c62-affa-5c020b363710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8161f3c-4e34-423b-bcd4-f91d6f913b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Volume 8f4a7a29-4a27-4675-8ae6-726bd2668a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61', 'volume_size': 1} Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:36 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-918327725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4a7a29-4a27-4675-8ae6-726bd2668a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24c55bd39b4cf68d51703a36c505b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:36Z,use_quota=True,user_id='439062614d054432b4418ff877280425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Creating volume 8f4a7a29-4a27-4675-8ae6-726bd2668a61 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:37 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:04:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:37 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 1073741824 Nov 02 10:04:37 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7c9a7995-c934-48cf-9055-fa765d5ccafa tempest-SnapshotsActionsTest-1985146038 None] Create snapshot completed successfully Nov 02 10:04:37 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:38 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 1073741824" returned: 0 in 1.068s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-ca983c0d-6235-4001-a0b2-b30f59b36663-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-ca983c0d-6235-4001-a0b2-b30f59b36663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-ca983c0d-6235-4001-a0b2-b30f59b36663" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-ca983c0d-6235-4001-a0b2-b30f59b36663" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Deleting offline snapshot ca983c0d-6235-4001-a0b2-b30f59b36663 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:38 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 Nov 02 10:04:38 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] snapshot_file for this snap is: volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff11009-53b3-4e88-8328-2138db120652]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:38 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 Nov 02 10:04:38 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:38 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61" returned: 0 in 0.534s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8161f3c-4e34-423b-bcd4-f91d6f913b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f361f4b7-9bba-4d5e-a691-6d8acdac8d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Volume volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 (8f4a7a29-4a27-4675-8ae6-726bd2668a61): created successfully Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f361f4b7-9bba-4d5e-a691-6d8acdac8d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Flow 'volume_create_manager' (93e6097a-8d87-42df-9b24-9afd6cdf7633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:38 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-1b14e390-2242-4cea-b4eb-27b046fbc4af tempest-AttachVolumeTestJSON-832289464 None] Created volume successfully. Nov 02 10:04:38 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663" returned: 0 in 0.642s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[887c0e4d-1401-4cb7-87f8-9563664a3f3c]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:39 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:39 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:39 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.551s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:39 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 Nov 02 10:04:39 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:40 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663" returned: 0 in 0.847s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:40 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663 Nov 02 10:04:40 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:41 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.ca983c0d-6235-4001-a0b2-b30f59b36663" returned: 0 in 0.800s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-ca983c0d-6235-4001-a0b2-b30f59b36663" released by "_delete_snapshot" :: held 3.037s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" released by "delete_snapshot" :: held 3.092s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Created reservations ['2f067060-ff2c-42ba-b84c-c7cf8b57fc42', 'a65836ad-39c9-4866-99a4-75d95b0c60ce', 'a8963c54-aeea-41b8-89cd-93c31f85d47f', '13de32d0-b4ea-41a8-9f62-5d74e653eed6'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-742ad05d-7797-4041-a3ed-909ee82a9d53 req-4ec258c8-12ba-4af1-94a3-9697d55ac31f tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-742ad05d-7797-4041-a3ed-909ee82a9d53 req-4ec258c8-12ba-4af1-94a3-9697d55ac31f tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-742ad05d-7797-4041-a3ed-909ee82a9d53 req-4ec258c8-12ba-4af1-94a3-9697d55ac31f tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-742ad05d-7797-4041-a3ed-909ee82a9d53 req-4ec258c8-12ba-4af1-94a3-9697d55ac31f tempest-AttachVolumeTestJSON-832289464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60dcf243-bda4-42af-80ee-cdddf667fa29', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:04:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Delete snapshot completed successfully. Nov 02 10:04:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3ac57d7b-8daa-4a0c-8756-9933a5b76fd7 tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-ca983c0d-6235-4001-a0b2-b30f59b36663-delete_snapshot" released by "delete_snapshot" :: held 3.537s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-742ad05d-7797-4041-a3ed-909ee82a9d53 req-4ec258c8-12ba-4af1-94a3-9697d55ac31f tempest-AttachVolumeTestJSON-832289464 None] attachment_update completed successfully. Nov 02 10:04:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Creating offline snapshot 91d29884-1c41-4a4c-a4f2-593da7addf75 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:04:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b0655b-e7e8-44b0-94b0-a5e4c4088da8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:43 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:43 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:44 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.912s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:44 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 1G Nov 02 10:04:44 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:45 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 1G" returned: 0 in 0.916s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:45 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 Nov 02 10:04:45 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:46 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75" returned: 0 in 1.010s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:46 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 is being set with open permissions: ugo+rw Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:46 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 Nov 02 10:04:46 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=99,cinder:UPDATE=86,cinder:INSERT=29,cinder:DELETE=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=103,cinder:SELECT=94,cinder:INSERT=29,cinder:DELETE=11 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Flow 'volume_create_manager' (bebaad6a-0a65-4e41-b792-d77fd294056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2d4c18-80d2-4499-8f69-a2a74c303c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:46 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2d4c18-80d2-4499-8f69-a2a74c303c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-158205224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966e8f42-1c36-4deb-8ed7-838480a49324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e6e81b8d3d463db40b4755d0517d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:47Z,use_quota=True,user_id='fd3752841b014812aef5148b8fada5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b92cf2-4707-40cf-97c1-80af6eb57fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b92cf2-4707-40cf-97c1-80af6eb57fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8036b8-22aa-4a5b-b422-b5304befcf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8036b8-22aa-4a5b-b422-b5304befcf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966e8f42-1c36-4deb-8ed7-838480a49324', 'volume_name': 'volume-966e8f42-1c36-4deb-8ed7-838480a49324', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7f1075-491a-4618-b2aa-66108863b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7f1075-491a-4618-b2aa-66108863b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a1ed9a-fd20-47e9-83cc-cdfcb51fb593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:47 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Volume 966e8f42-1c36-4deb-8ed7-838480a49324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966e8f42-1c36-4deb-8ed7-838480a49324', 'volume_size': 1} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75" returned: 0 in 0.706s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.813s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.156s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-158205224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966e8f42-1c36-4deb-8ed7-838480a49324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e6e81b8d3d463db40b4755d0517d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:47Z,use_quota=True,user_id='fd3752841b014812aef5148b8fada5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Creating volume 966e8f42-1c36-4deb-8ed7-838480a49324 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:47 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:04:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:47 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 1073741824 Nov 02 10:04:47 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:47 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9f294c7a-cbee-4be1-9b19-da9ed2c6ba59 tempest-SnapshotsActionsTest-1985146038 None] Create snapshot completed successfully Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-91d29884-1c41-4a4c-a4f2-593da7addf75-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-91d29884-1c41-4a4c-a4f2-593da7addf75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Acquiring lock "cinder-quobyte-91d29884-1c41-4a4c-a4f2-593da7addf75" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-91d29884-1c41-4a4c-a4f2-593da7addf75" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Deleting offline snapshot 91d29884-1c41-4a4c-a4f2-593da7addf75 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] snapshot_file for this snap is: volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[46345cce-c4b3-4434-92ae-3ca415ea4d64]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:48 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 1073741824" returned: 0 in 1.155s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:48 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 Nov 02 10:04:48 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:48 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 Nov 02 10:04:48 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:04:48 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75" returned: 0 in 0.719s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:49 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324" returned: 0 in 0.548s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f335c3e-6c54-4873-9b9f-8051f16c9384]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a1ed9a-fd20-47e9-83cc-cdfcb51fb593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966e8f42-1c36-4deb-8ed7-838480a49324', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47afbd08-92c4-4ac3-ad67-bc4f6752c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:49 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Volume volume-966e8f42-1c36-4deb-8ed7-838480a49324 (966e8f42-1c36-4deb-8ed7-838480a49324): created successfully Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47afbd08-92c4-4ac3-ad67-bc4f6752c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Flow 'volume_create_manager' (bebaad6a-0a65-4e41-b792-d77fd294056e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-edbfb72f-c772-4e72-bba0-73d44043653b tempest-VolumesNegativeTest-359924760 None] Created volume successfully. Nov 02 10:04:49 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:49 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:49 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.793s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:49 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 Nov 02 10:04:49 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:50 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75" returned: 0 in 0.710s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:50 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75 Nov 02 10:04:50 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:51 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.91d29884-1c41-4a4c-a4f2-593da7addf75" returned: 0 in 0.644s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-91d29884-1c41-4a4c-a4f2-593da7addf75" released by "_delete_snapshot" :: held 3.187s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" released by "delete_snapshot" :: held 3.253s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:51 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Created reservations ['10db9578-7bab-463c-9691-e698db3f7beb', '9351199e-8eaa-4fac-81be-7640afe4b6cc', '8546ffe7-e2c9-4733-9ae0-1163ab7fda2e', '16a4c2f8-d5dd-44fc-8980-d95d79960927'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Delete snapshot completed successfully. Nov 02 10:04:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8756cc1-8959-4fe8-b645-e7068337ac4e tempest-SnapshotsActionsTest-438016160 None] Lock "cinder-91d29884-1c41-4a4c-a4f2-593da7addf75-delete_snapshot" released by "delete_snapshot" :: held 3.786s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "cinder-b7ae4774-33ec-45e7-826e-bf8b2a264c45-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-b7ae4774-33ec-45e7-826e-bf8b2a264c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "cinder-quobyte-b7ae4774-33ec-45e7-826e-bf8b2a264c45" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-quobyte-b7ae4774-33ec-45e7-826e-bf8b2a264c45" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Deleting offline snapshot b7ae4774-33ec-45e7-826e-bf8b2a264c45 of volume 0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] snapshot_file for this snap is: volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e9abf7-60f2-44f0-b7ee-f3ef847280f9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:54 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:54 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:55 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.876s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[67522294-21d8-4a94-a678-8e0741d1bdd9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:55 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 Nov 02 10:04:55 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:56 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-5867187a-8499-4b4d-834a-46bbeac717b4 req-94912bd2-16e1-45bd-9fa6-0b51a4c85dcd tempest-ServerActionsTestOtherA-1451225399 None] Terminate volume connection completed successfully. Nov 02 10:04:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-5867187a-8499-4b4d-834a-46bbeac717b4 req-94912bd2-16e1-45bd-9fa6-0b51a4c85dcd tempest-ServerActionsTestOtherA-1451225399 None] Deleting attachment bdaef088-a5c6-4c2c-8564-41fa8a7ec38e. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:04:56 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" returned: 0 in 0.965s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:56 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:56 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:57 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.596s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:57 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45 Nov 02 10:04:57 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:57 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5.b7ae4774-33ec-45e7-826e-bf8b2a264c45" returned: 0 in 0.409s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-quobyte-b7ae4774-33ec-45e7-826e-bf8b2a264c45" released by "_delete_snapshot" :: held 3.179s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" released by "delete_snapshot" :: held 3.247s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:57 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Created reservations ['6f86aab8-4b73-45d9-a212-f7b28e36c85b', '7f321583-7efa-45e0-8971-04215fb3be4c', '2b7ea1eb-54af-488f-99e9-342b1ec5799d', '2e9670ca-1735-4bc9-9033-39586c2d76a6'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Delete snapshot completed successfully. Nov 02 10:04:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8e8616e2-b438-43ac-950c-4a0dd0fbaf97 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-b7ae4774-33ec-45e7-826e-bf8b2a264c45-delete_snapshot" released by "delete_snapshot" :: held 3.527s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "cinder-0c366c17-f1e8-4ba1-81f0-c7e109dafda5-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-0c366c17-f1e8-4ba1-81f0-c7e109dafda5-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-5867187a-8499-4b4d-834a-46bbeac717b4 req-59ab2cc7-024f-4074-b459-44f62924b2a8 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-5867187a-8499-4b4d-834a-46bbeac717b4 req-59ab2cc7-024f-4074-b459-44f62924b2a8 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-5867187a-8499-4b4d-834a-46bbeac717b4 req-59ab2cc7-024f-4074-b459-44f62924b2a8 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6555cf-e72a-4d67-8860-43d6564cac50]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-5867187a-8499-4b4d-834a-46bbeac717b4 req-59ab2cc7-024f-4074-b459-44f62924b2a8 tempest-ServerActionsTestOtherA-1451225399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-252207df-c64f-40fe-9b32-cd92c91af301', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f9dce6f-2e3f-40c4-a313-e90f685f1c21', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:04:59 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-5867187a-8499-4b4d-834a-46bbeac717b4 req-59ab2cc7-024f-4074-b459-44f62924b2a8 tempest-ServerActionsTestOtherA-1451225399 None] attachment_update completed successfully. Nov 02 10:04:59 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 Nov 02 10:04:59 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:00 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" returned: 0 in 0.973s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:00 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5 Nov 02 10:05:00 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:01 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" returned: 0 in 0.928s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-quobyte-0c366c17-f1e8-4ba1-81f0-c7e109dafda5" released by "delete_volume" :: held 2.027s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Created reservations ['665f4caf-dd51-444a-be29-ae9297d47763', '0117109c-7b37-46f2-8c4f-5fe1ad0b5b06', 'babbadd8-2941-437c-8d21-efff6725efeb', 'd02b02e8-6dc8-4235-b672-8402f21a0753'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:01 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:05:01 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:02 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.566s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:02 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:02 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Deleted volume successfully. Nov 02 10:05:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-84fa494a-8076-4467-929d-02b4d4ea2a84 tempest-SnapshotsActionsTest-1985146038 None] Lock "cinder-0c366c17-f1e8-4ba1-81f0-c7e109dafda5-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:11 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=25,cinder:DELETE=2,cinder:UPDATE=23,cinder:INSERT=5 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:12 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Acquiring lock "cinder-966e8f42-1c36-4deb-8ed7-838480a49324-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Lock "cinder-966e8f42-1c36-4deb-8ed7-838480a49324-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Acquiring lock "cinder-quobyte-966e8f42-1c36-4deb-8ed7-838480a49324" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Lock "cinder-quobyte-966e8f42-1c36-4deb-8ed7-838480a49324" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b4327-06c9-4def-b308-40c04c2d7326]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:23 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 Nov 02 10:05:23 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:23 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324" returned: 0 in 0.498s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:23 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324 Nov 02 10:05:23 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:24 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-966e8f42-1c36-4deb-8ed7-838480a49324" returned: 0 in 0.349s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Lock "cinder-quobyte-966e8f42-1c36-4deb-8ed7-838480a49324" released by "delete_volume" :: held 0.905s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Created reservations ['97329300-48d8-40a2-a562-65e01604656b', '8d112d8d-79f0-4eeb-96c3-5f6f99e49f36', '788729cd-3211-4f1f-8c87-30957b72b76e', '7d62642d-f2ca-4a27-a1ea-e9e580fb26e4'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:24 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:05:24 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:24 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.332s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Deleted volume successfully. Nov 02 10:05:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d6fee85-911b-4a02-bd58-390ed2b89032 tempest-VolumesNegativeTest-359924760 None] Lock "cinder-966e8f42-1c36-4deb-8ed7-838480a49324-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Flow 'volume_create_manager' (07b4644d-5a32-46d5-bb32-38fefbb3df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f4745d-84ed-40fd-9ab8-4659523ed866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f4745d-84ed-40fd-9ab8-4659523ed866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-533966029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15fb930-0e51-4fe0-8867-26284d4959a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9822b84345cf42a0ab62a88f698eb4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:29Z,use_quota=True,user_id='801f680c68d04925b217f23bd1bbc7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1c7f14-97e3-406c-bf9b-bc094945351f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1c7f14-97e3-406c-bf9b-bc094945351f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d4c496-0665-4f25-8fe0-54f25064c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d4c496-0665-4f25-8fe0-54f25064c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15fb930-0e51-4fe0-8867-26284d4959a7', 'volume_name': 'volume-c15fb930-0e51-4fe0-8867-26284d4959a7', 'volume_size': 2}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f023396-8637-4363-8f07-68a2e863e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f023396-8637-4363-8f07-68a2e863e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73670f8d-48c4-427b-b601-f125b0e65c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Volume c15fb930-0e51-4fe0-8867-26284d4959a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15fb930-0e51-4fe0-8867-26284d4959a7', 'volume_size': 2} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-533966029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15fb930-0e51-4fe0-8867-26284d4959a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9822b84345cf42a0ab62a88f698eb4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:29Z,use_quota=True,user_id='801f680c68d04925b217f23bd1bbc7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Creating volume c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:29 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 2147483648 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:29 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 2147483648 Nov 02 10:05:29 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:29 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 2147483648" returned: 0 in 0.520s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:29 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 Nov 02 10:05:29 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:30 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7" returned: 0 in 0.287s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73670f8d-48c4-427b-b601-f125b0e65c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15fb930-0e51-4fe0-8867-26284d4959a7', 'volume_size': 2}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17938962-ca32-4d4d-bcc4-65df885bc6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:30 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Volume volume-c15fb930-0e51-4fe0-8867-26284d4959a7 (c15fb930-0e51-4fe0-8867-26284d4959a7): created successfully Nov 02 10:05:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17938962-ca32-4d4d-bcc4-65df885bc6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Flow 'volume_create_manager' (07b4644d-5a32-46d5-bb32-38fefbb3df4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-596ac0c5-1e58-461a-b0b0-76b2e538695d tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Created volume successfully. Nov 02 10:05:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Creating offline snapshot 42f52f81-2058-44fe-bdf3-53eb795365fc of volume c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:05:31 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ba5587-7cc1-47d7-a573-9abed6b38b61]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:31 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 Nov 02 10:05:31 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:32 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7" returned: 0 in 0.456s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc 2G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:32 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc 2G Nov 02 10:05:32 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:32 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc 2G" returned: 0 in 0.713s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15fb930-0e51-4fe0-8867-26284d4959a7 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:32 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15fb930-0e51-4fe0-8867-26284d4959a7 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc Nov 02 10:05:32 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:32 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-34273d90-942b-4934-9b0d-4260a6cba687 req-048bd29e-e8b6-451d-8e13-da25fc31d222 tempest-AttachVolumeTestJSON-832289464 None] Terminate volume connection completed successfully. Nov 02 10:05:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-34273d90-942b-4934-9b0d-4260a6cba687 req-048bd29e-e8b6-451d-8e13-da25fc31d222 tempest-AttachVolumeTestJSON-832289464 None] Deleting attachment 60dcf243-bda4-42af-80ee-cdddf667fa29. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:05:33 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15fb930-0e51-4fe0-8867-26284d4959a7 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc" returned: 0 in 0.517s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:33 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc is being set with open permissions: ugo+rw Nov 02 10:05:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:33 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc Nov 02 10:05:33 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:33 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc" returned: 0 in 0.435s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:33 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.info Nov 02 10:05:33 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:34 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.info" returned: 0 in 0.523s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:34 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.info is being set with open permissions: ugo+rw Nov 02 10:05:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:34 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.info Nov 02 10:05:34 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:34 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.info" returned: 0 in 0.374s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5849acff-dfa4-45c8-94fc-a437dc5b74bc tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Create snapshot completed successfully Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "cinder-42f52f81-2058-44fe-bdf3-53eb795365fc-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-42f52f81-2058-44fe-bdf3-53eb795365fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "cinder-quobyte-c15fb930-0e51-4fe0-8867-26284d4959a7" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-quobyte-c15fb930-0e51-4fe0-8867-26284d4959a7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "cinder-quobyte-42f52f81-2058-44fe-bdf3-53eb795365fc" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-quobyte-42f52f81-2058-44fe-bdf3-53eb795365fc" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Deleting offline snapshot 42f52f81-2058-44fe-bdf3-53eb795365fc of volume c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] snapshot_file for this snap is: volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07cb49d-fdcf-4ce9-9dea-aa3e9d305021]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:36 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc Nov 02 10:05:36 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:36 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc" returned: 0 in 0.472s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15fb930-0e51-4fe0-8867-26284d4959a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8516c-541e-43cf-99c0-3d0733017f80]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:36 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 Nov 02 10:05:36 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:37 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7" returned: 0 in 0.472s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:37 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc Nov 02 10:05:37 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:37 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc" returned: 0 in 0.768s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:38 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc Nov 02 10:05:38 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:38 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7.42f52f81-2058-44fe-bdf3-53eb795365fc" returned: 0 in 0.342s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-quobyte-42f52f81-2058-44fe-bdf3-53eb795365fc" released by "_delete_snapshot" :: held 2.323s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-quobyte-c15fb930-0e51-4fe0-8867-26284d4959a7" released by "delete_snapshot" :: held 2.381s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:38 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Created reservations ['5cdef89f-b910-4cc5-8451-5ffe0fcfc533', 'f3382b2e-ed11-402f-a0e8-6306362e3f62', '51377c30-5999-45df-921a-a77c80891581', 'dcc5710a-0cf2-46ee-b6a1-6f6724aa8184'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:38 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Delete snapshot completed successfully. Nov 02 10:05:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c8f3bf85-c8d7-4e39-8a46-89fd9e5c957a tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-42f52f81-2058-44fe-bdf3-53eb795365fc-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "cinder-c15fb930-0e51-4fe0-8867-26284d4959a7-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-c15fb930-0e51-4fe0-8867-26284d4959a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "cinder-quobyte-c15fb930-0e51-4fe0-8867-26284d4959a7" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-quobyte-c15fb930-0e51-4fe0-8867-26284d4959a7" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3b7244-5d34-4689-9c0b-591805168a65]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:39 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 Nov 02 10:05:39 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:40 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7" returned: 0 in 0.593s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:40 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7 Nov 02 10:05:40 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:40 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c15fb930-0e51-4fe0-8867-26284d4959a7" returned: 0 in 0.379s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-quobyte-c15fb930-0e51-4fe0-8867-26284d4959a7" released by "delete_volume" :: held 1.080s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Created reservations ['26e87c81-1a78-462b-ae57-f9e7388d75e7', 'ed3bd15f-cde9-4b8f-99a0-0e114fcb2b07', 'fdeb290b-eddf-4f99-9d4d-f697cf76b474', 'f143ccfb-f8a8-4bd6-9986-3b3a0dc36bf6'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:40 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:05:40 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:41 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.293s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:41 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Deleted volume successfully. Nov 02 10:05:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f03128e-cc16-43b2-a5e8-f121231a6572 tempest-VolumesSnapshotNegativeTestJSON-185471374 None] Lock "cinder-c15fb930-0e51-4fe0-8867-26284d4959a7-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:43 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Flow 'volume_create_manager' (37b7ea9d-a69f-4155-ad96-015f0b1ca065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd2de66-44b2-4e79-a9cb-32acd21390fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd2de66-44b2-4e79-a9cb-32acd21390fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1323791374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cf69b3-2dab-4216-ba86-fd939e7342b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9821a1f2f3a41a1a34490f110b2a549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:44Z,use_quota=True,user_id='57ddb0467fee4092b84095e5509deed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1589e208-b96c-4031-af77-64dd67acb91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1589e208-b96c-4031-af77-64dd67acb91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9676272c-fc07-48e5-ae85-d3c29e9dcecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9676272c-fc07-48e5-ae85-d3c29e9dcecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cf69b3-2dab-4216-ba86-fd939e7342b4', 'volume_name': 'volume-48cf69b3-2dab-4216-ba86-fd939e7342b4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f24e54b-e8c5-499b-8712-85bfc3f1811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f24e54b-e8c5-499b-8712-85bfc3f1811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a158ce49-f3ed-44e8-b531-e6284278e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Volume 48cf69b3-2dab-4216-ba86-fd939e7342b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cf69b3-2dab-4216-ba86-fd939e7342b4', 'volume_size': 1} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1323791374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cf69b3-2dab-4216-ba86-fd939e7342b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9821a1f2f3a41a1a34490f110b2a549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:44Z,use_quota=True,user_id='57ddb0467fee4092b84095e5509deed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Creating volume 48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:44 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:44 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 1073741824 Nov 02 10:05:44 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:44 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 1073741824" returned: 0 in 0.517s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:44 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 Nov 02 10:05:44 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:44 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4" returned: 0 in 0.318s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a158ce49-f3ed-44e8-b531-e6284278e91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cf69b3-2dab-4216-ba86-fd939e7342b4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556acba2-80ce-4353-8146-5f232adafd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Volume volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 (48cf69b3-2dab-4216-ba86-fd939e7342b4): created successfully Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556acba2-80ce-4353-8146-5f232adafd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Flow 'volume_create_manager' (37b7ea9d-a69f-4155-ad96-015f0b1ca065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4b0051c9-5935-4252-9918-e121aedca742 tempest-VolumesDeleteCascade-849311634 None] Created volume successfully. Nov 02 10:05:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Creating offline snapshot 43935284-0982-42a9-91e9-ef1e4b67e18a of volume 48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:05:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9004eb-6a18-4a4b-8bd4-8315ac905568]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:46 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 Nov 02 10:05:46 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:47 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4" returned: 0 in 0.689s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:47 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a 1G Nov 02 10:05:47 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:47 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a 1G" returned: 0 in 0.514s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:47 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a Nov 02 10:05:47 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a" returned: 0 in 0.376s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:48 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a is being set with open permissions: ugo+rw Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:48 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a Nov 02 10:05:48 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a" returned: 0 in 0.334s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:48 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.info Nov 02 10:05:48 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:48 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:05:48 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.info" returned: 0 in 0.467s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:48 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.info is being set with open permissions: ugo+rw Nov 02 10:05:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:49 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.info Nov 02 10:05:49 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:49 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.465s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:05:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:05:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:05:49 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.info" returned: 0 in 0.631s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.189s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d54fb7ae-cf52-417c-8754-d9993f8df9aa tempest-VolumesDeleteCascade-849311634 None] Create snapshot completed successfully Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Creating offline snapshot 10920bb3-8808-4e36-87f8-44bc168e7025 of volume 48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7587ebc-6c55-4b5f-873a-d6d040a43d70]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:51 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a Nov 02 10:05:51 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:51 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a" returned: 0 in 0.493s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48cf69b3-2dab-4216-ba86-fd939e7342b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:51 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 1G Nov 02 10:05:51 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:52 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 1G" returned: 0 in 0.577s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:52 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 Nov 02 10:05:52 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:52 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025" returned: 0 in 0.402s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:52 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 is being set with open permissions: ugo+rw Nov 02 10:05:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:52 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 Nov 02 10:05:52 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:53 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025" returned: 0 in 0.469s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-19671874-aea4-4bd1-a7ad-86c4f0cb6c0d tempest-VolumesDeleteCascade-849311634 None] Create snapshot completed successfully Nov 02 10:05:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-d634d54e-a0e0-4196-a245-4646779e3431 req-fee931dd-2461-4bf6-af4c-f2d8b5cc8e61 tempest-ServerActionsTestOtherA-1451225399 None] Terminate volume connection completed successfully. Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-d634d54e-a0e0-4196-a245-4646779e3431 req-fee931dd-2461-4bf6-af4c-f2d8b5cc8e61 tempest-ServerActionsTestOtherA-1451225399 None] Deleting attachment 0f9dce6f-2e3f-40c4-a313-e90f685f1c21. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "cinder-252207df-c64f-40fe-9b32-cd92c91af301-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-252207df-c64f-40fe-9b32-cd92c91af301-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "cinder-quobyte-252207df-c64f-40fe-9b32-cd92c91af301" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-quobyte-252207df-c64f-40fe-9b32-cd92c91af301" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf28511-a0f3-4f9b-a11f-867618f28db1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:54 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 Nov 02 10:05:54 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-48cf69b3-2dab-4216-ba86-fd939e7342b4-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-48cf69b3-2dab-4216-ba86-fd939e7342b4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Performing cascade delete. {{(pid=87005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-10920bb3-8808-4e36-87f8-44bc168e7025-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-10920bb3-8808-4e36-87f8-44bc168e7025-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:54 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301" returned: 0 in 0.737s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-10920bb3-8808-4e36-87f8-44bc168e7025" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-10920bb3-8808-4e36-87f8-44bc168e7025" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Deleting offline snapshot 10920bb3-8808-4e36-87f8-44bc168e7025 of volume 48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:05:54 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301 Nov 02 10:05:54 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] snapshot_file for this snap is: volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832ba5b-e2f5-4506-8223-c0fb0e5766cc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:54 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 Nov 02 10:05:54 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:55 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-252207df-c64f-40fe-9b32-cd92c91af301" returned: 0 in 0.397s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-quobyte-252207df-c64f-40fe-9b32-cd92c91af301" released by "delete_volume" :: held 1.209s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.quota [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Created reservations ['34e516bf-91fe-4888-9fa9-67ba5aa90201', 'bd8cc021-dc1f-4c73-817b-d905ea744799', '95ffd115-fd96-4860-aa69-2900c9320841', '797b35f5-188e-4610-9eba-e9f85a3ce6fe'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:55 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:05:55 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:55 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025" returned: 0 in 0.548s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48cf69b3-2dab-4216-ba86-fd939e7342b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd375b8-453b-4215-99f0-6a5d72fc00fb]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:55 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a Nov 02 10:05:55 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:55 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.388s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.manager [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Deleted volume successfully. Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-d634d54e-a0e0-4196-a245-4646779e3431 req-22c3f648-cc3a-4c55-93a1-7a0285546de9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-252207df-c64f-40fe-9b32-cd92c91af301-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:55 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a" returned: 0 in 0.583s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48cf69b3-2dab-4216-ba86-fd939e7342b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:56 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 Nov 02 10:05:56 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "cinder-9fe86ec8-9a7d-4281-a198-c4a763c4305f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-9fe86ec8-9a7d-4281-a198-c4a763c4305f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "cinder-quobyte-9fe86ec8-9a7d-4281-a198-c4a763c4305f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-quobyte-9fe86ec8-9a7d-4281-a198-c4a763c4305f" acquired by "delete_volume" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfbb76-7586-4e4e-8ae1-0eb7f951d988]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:56 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f Nov 02 10:05:56 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:56 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025" returned: 0 in 0.624s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:56 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025 Nov 02 10:05:56 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:56 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f" returned: 0 in 0.525s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:56 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f Nov 02 10:05:56 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:56 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.10920bb3-8808-4e36-87f8-44bc168e7025" returned: 0 in 0.339s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-10920bb3-8808-4e36-87f8-44bc168e7025" released by "_delete_snapshot" :: held 2.295s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" released by "delete_snapshot" :: held 2.330s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Created reservations ['9bb4cb96-e1ca-4064-b8f5-3d4e434b5caa', '7549e0b3-2f42-455b-93f2-3a4d0a02df8b', '503d7689-50fb-4a3e-9e82-06c0fb1034d5', 'ce42e878-ab10-47fe-af3f-7afbc42935e5'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:57 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9fe86ec8-9a7d-4281-a198-c4a763c4305f" returned: 0 in 0.377s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Delete snapshot completed successfully. Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-quobyte-9fe86ec8-9a7d-4281-a198-c4a763c4305f" released by "delete_volume" :: held 0.979s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-10920bb3-8808-4e36-87f8-44bc168e7025-delete_snapshot" released by "delete_snapshot" :: held 2.662s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-43935284-0982-42a9-91e9-ef1e4b67e18a-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-43935284-0982-42a9-91e9-ef1e4b67e18a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-43935284-0982-42a9-91e9-ef1e4b67e18a" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Created reservations ['7d53c646-5b11-4a25-a6f8-b46ffef6e9bc', '0adadf09-7418-4422-abfd-faedf03ee96b', '596256f3-aa63-40e1-a25b-cca21125dbda', 'd4ebcee4-08ff-4106-9fe1-568f50d3aac6'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-43935284-0982-42a9-91e9-ef1e4b67e18a" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Deleting offline snapshot 43935284-0982-42a9-91e9-ef1e4b67e18a of volume 48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] snapshot_file for this snap is: volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[23897576-ee2e-4215-ba60-1581a18cc105]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:57 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a Nov 02 10:05:57 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:57 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:05:57 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:57 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a" returned: 0 in 0.515s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48cf69b3-2dab-4216-ba86-fd939e7342b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:58 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.448s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:58 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:58 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Deleted volume successfully. Nov 02 10:05:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[59772fd4-ef19-42a9-bff0-69adbfbe5c0b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4ea3cff-f61d-455f-909b-7124a11866c9 tempest-ServerActionsTestOtherA-1451225399 None] Lock "cinder-9fe86ec8-9a7d-4281-a198-c4a763c4305f-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:58 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 Nov 02 10:05:58 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:58 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4" returned: 0 in 0.445s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:58 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a Nov 02 10:05:58 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:59 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a" returned: 0 in 0.822s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:59 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a Nov 02 10:05:59 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:59 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4.43935284-0982-42a9-91e9-ef1e4b67e18a" returned: 0 in 0.378s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-43935284-0982-42a9-91e9-ef1e4b67e18a" released by "_delete_snapshot" :: held 2.371s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" released by "delete_snapshot" :: held 2.433s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:59 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Created reservations ['2ca2fa60-5703-4ed6-8647-03964c797e2d', 'bbb4bf48-ca1c-4408-ab5b-37f532124e6a', 'c1353e42-9cb7-4f89-a61c-8ecfe462ce06', 'c80d6a82-5558-423b-aee2-54ac4abaabfb'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Delete snapshot completed successfully. Nov 02 10:06:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-43935284-0982-42a9-91e9-ef1e4b67e18a-delete_snapshot" released by "delete_snapshot" :: held 2.813s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Snapshots deleted, issuing volume delete {{(pid=87005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:06:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" acquired by "delete_volume" :: waited 0.039s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa9166d-128c-4620-90c6-d9c06aa81b39]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:00 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 Nov 02 10:06:00 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:01 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4" returned: 0 in 0.950s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:01 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4 Nov 02 10:06:01 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:01 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48cf69b3-2dab-4216-ba86-fd939e7342b4" returned: 0 in 0.369s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-48cf69b3-2dab-4216-ba86-fd939e7342b4" released by "delete_volume" :: held 1.452s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Created reservations ['415eeff2-f001-43c2-93ee-66d8fc1fcab3', '94d48981-c4ae-44d3-80de-1d9d589a0a8e', '25a9a51f-393b-4b87-a7f4-220de4088975', '155b6505-62e6-4b29-85a8-f2f7ecafee10'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:01 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:06:01 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:02 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.346s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:02 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:02 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Deleted volume successfully. Nov 02 10:06:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-847bc32a-a67a-49e0-ad81-56b469a9a5cb tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-48cf69b3-2dab-4216-ba86-fd939e7342b4-delete_volume" released by "delete_volume" :: held 7.852s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Flow 'volume_create_manager' (2e029cd3-a81a-4ca7-8df0-6af7d2d5e41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563023f6-6d73-4b68-a2af-af2109b43460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563023f6-6d73-4b68-a2af-af2109b43460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1098931412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8786dc-1bd2-452d-9168-8e55eda13aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9821a1f2f3a41a1a34490f110b2a549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:04Z,use_quota=True,user_id='57ddb0467fee4092b84095e5509deed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52034eb7-c7db-458a-aa8f-1e7ba6aae770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52034eb7-c7db-458a-aa8f-1e7ba6aae770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7309f9dd-3206-426c-8b8b-cd9da57bedb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7309f9dd-3206-426c-8b8b-cd9da57bedb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8786dc-1bd2-452d-9168-8e55eda13aa3', 'volume_name': 'volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9203178d-ffac-4368-8cd8-0cb2f182e76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9203178d-ffac-4368-8cd8-0cb2f182e76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49715b7e-d862-4592-8b6d-1516bcf58e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:04 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Volume 1f8786dc-1bd2-452d-9168-8e55eda13aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3', 'volume_size': 1} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1098931412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8786dc-1bd2-452d-9168-8e55eda13aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9821a1f2f3a41a1a34490f110b2a549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:04Z,use_quota=True,user_id='57ddb0467fee4092b84095e5509deed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Creating volume 1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:04 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:04 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 1073741824 Nov 02 10:06:04 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:04 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 1073741824" returned: 0 in 0.635s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:04 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 Nov 02 10:06:04 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:05 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3" returned: 0 in 0.354s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49715b7e-d862-4592-8b6d-1516bcf58e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d82f731-a911-4c7e-a32e-4fd88df5a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:05 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Volume volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 (1f8786dc-1bd2-452d-9168-8e55eda13aa3): created successfully Nov 02 10:06:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d82f731-a911-4c7e-a32e-4fd88df5a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Flow 'volume_create_manager' (2e029cd3-a81a-4ca7-8df0-6af7d2d5e41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-17afd77a-2f83-4742-abbb-629c1292aac4 tempest-VolumesDeleteCascade-849311634 None] Created volume successfully. Nov 02 10:06:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Creating offline snapshot de1ad55e-c15f-4d13-b6af-d28451318bf4 of volume 1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:06:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8f9851-9f69-4042-a4b6-5e63bbde8380]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:06 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 Nov 02 10:06:06 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:06 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3" returned: 0 in 0.616s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:06 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 1G Nov 02 10:06:06 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:07 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 1G" returned: 0 in 0.623s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:07 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 Nov 02 10:06:07 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:07 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4" returned: 0 in 0.371s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:07 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 is being set with open permissions: ugo+rw Nov 02 10:06:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:07 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 Nov 02 10:06:07 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:08 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4" returned: 0 in 0.322s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:08 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.info Nov 02 10:06:08 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:08 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.info" returned: 0 in 0.272s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:08 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.info is being set with open permissions: ugo+rw Nov 02 10:06:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:08 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.info Nov 02 10:06:08 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:08 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.info" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6f0d239c-fae3-48b6-b8be-7070eb0cc0e4 tempest-VolumesDeleteCascade-849311634 None] Create snapshot completed successfully Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Flow 'volume_create_manager' (ac839dc1-ebd8-4fee-ba60-085d0b08b319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc62630-7642-49b9-9a5b-1f669f13db9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc62630-7642-49b9-9a5b-1f669f13db9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1742180282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dcb6d4-5111-428c-abaa-1164b434aa77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9821a1f2f3a41a1a34490f110b2a549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de1ad55e-c15f-4d13-b6af-d28451318bf4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:10Z,use_quota=True,user_id='57ddb0467fee4092b84095e5509deed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2767f0-8f66-4c40-9f82-603875183f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2767f0-8f66-4c40-9f82-603875183f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41942746-089f-49c0-9ecc-e88174e22a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41942746-089f-49c0-9ecc-e88174e22a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27dcb6d4-5111-428c-abaa-1164b434aa77', 'volume_name': 'volume-27dcb6d4-5111-428c-abaa-1164b434aa77', 'volume_size': 1, 'snapshot_id': 'de1ad55e-c15f-4d13-b6af-d28451318bf4'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb94462-546c-449e-a9a8-0f385f9385a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb94462-546c-449e-a9a8-0f385f9385a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3986ce-4ffc-49c6-9d16-c37eae5fa8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:10 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Volume 27dcb6d4-5111-428c-abaa-1164b434aa77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27dcb6d4-5111-428c-abaa-1164b434aa77', 'volume_size': 1, 'snapshot_id': 'de1ad55e-c15f-4d13-b6af-d28451318bf4'} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-de1ad55e-c15f-4d13-b6af-d28451318bf4-27dcb6d4-5111-428c-abaa-1164b434aa77" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-de1ad55e-c15f-4d13-b6af-d28451318bf4-27dcb6d4-5111-428c-abaa-1164b434aa77" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Creating volume 27dcb6d4-5111-428c-abaa-1164b434aa77 from snapshot de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-27dcb6d4-5111-428c-abaa-1164b434aa77" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-27dcb6d4-5111-428c-abaa-1164b434aa77" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] snapshot: de1ad55e-c15f-4d13-b6af-d28451318bf4, volume: 27dcb6d4-5111-428c-abaa-1164b434aa77, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e26f65-bac2-433a-97b8-527fd7d00e1d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:10 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 Nov 02 10:06:10 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:10 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4" returned: 0 in 0.481s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af4cae-2cee-4ac5-8065-ef5f745f7058]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:11 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 Nov 02 10:06:11 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:11 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3" returned: 0 in 0.519s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:06:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:06:11 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:06:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:11 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 Nov 02 10:06:11 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:20 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=65,cinder:INSERT=17,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:20 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=74,cinder:SELECT=64,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:21 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77" returned: 0 in 9.743s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3, size 1024.00 MB, duration 9.74 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:06:21 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Converted 1024.00 MB image at 105.09 MB/s Nov 02 10:06:21 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 is being set with open permissions: ugo+rw Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:21 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 Nov 02 10:06:21 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:21 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77" returned: 0 in 0.289s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-27dcb6d4-5111-428c-abaa-1164b434aa77" released by "_copy_volume_from_snapshot" :: held 11.192s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-de1ad55e-c15f-4d13-b6af-d28451318bf4-27dcb6d4-5111-428c-abaa-1164b434aa77" released by "_create_volume_from_snapshot" :: held 11.285s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.307s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3986ce-4ffc-49c6-9d16-c37eae5fa8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27dcb6d4-5111-428c-abaa-1164b434aa77', 'volume_size': 1, 'snapshot_id': 'de1ad55e-c15f-4d13-b6af-d28451318bf4'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6623c5-1b92-46e6-babf-ebe21b71c524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:21 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Volume volume-27dcb6d4-5111-428c-abaa-1164b434aa77 (27dcb6d4-5111-428c-abaa-1164b434aa77): created successfully Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6623c5-1b92-46e6-babf-ebe21b71c524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Flow 'volume_create_manager' (ac839dc1-ebd8-4fee-ba60-085d0b08b319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-409fc01d-62a3-4e88-ae39-231de8f1bff8 tempest-VolumesDeleteCascade-849311634 None] Created volume successfully. Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-1f8786dc-1bd2-452d-9168-8e55eda13aa3-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-1f8786dc-1bd2-452d-9168-8e55eda13aa3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Performing cascade delete. {{(pid=87005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-de1ad55e-c15f-4d13-b6af-d28451318bf4-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-de1ad55e-c15f-4d13-b6af-d28451318bf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-1f8786dc-1bd2-452d-9168-8e55eda13aa3" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-1f8786dc-1bd2-452d-9168-8e55eda13aa3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-de1ad55e-c15f-4d13-b6af-d28451318bf4" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-de1ad55e-c15f-4d13-b6af-d28451318bf4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Deleting offline snapshot de1ad55e-c15f-4d13-b6af-d28451318bf4 of volume 1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] snapshot_file for this snap is: volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcffcd4-39c2-4483-909a-540dd409fed0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:23 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 Nov 02 10:06:23 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:23 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4" returned: 0 in 0.526s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e4b552-f04e-44f0-a330-f25c9c255279]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:24 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 Nov 02 10:06:24 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:24 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3" returned: 0 in 0.849s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:24 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 Nov 02 10:06:24 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:25 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4" returned: 0 in 0.605s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:25 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4 Nov 02 10:06:25 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:25 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3.de1ad55e-c15f-4d13-b6af-d28451318bf4" returned: 0 in 0.377s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-de1ad55e-c15f-4d13-b6af-d28451318bf4" released by "_delete_snapshot" :: held 2.547s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-1f8786dc-1bd2-452d-9168-8e55eda13aa3" released by "delete_snapshot" :: held 2.583s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:26 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Created reservations ['5b1e45af-00aa-4f57-90f8-23d866691294', '3235b11f-c2b0-4b9b-856b-74441b222ceb', '554d0fbb-5660-4450-8859-a14f97207dcb', '181d00c5-762d-438f-95de-319579a41752'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Delete snapshot completed successfully. Nov 02 10:06:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-de1ad55e-c15f-4d13-b6af-d28451318bf4-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Snapshots deleted, issuing volume delete {{(pid=87005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:06:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-1f8786dc-1bd2-452d-9168-8e55eda13aa3" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-1f8786dc-1bd2-452d-9168-8e55eda13aa3" acquired by "delete_volume" :: waited 0.037s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a2b2e-bcb5-4c5a-bba4-e17c9fbecc52]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:26 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 Nov 02 10:06:26 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:27 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3" returned: 0 in 0.492s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:27 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3 Nov 02 10:06:27 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:27 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1f8786dc-1bd2-452d-9168-8e55eda13aa3" returned: 0 in 0.453s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-1f8786dc-1bd2-452d-9168-8e55eda13aa3" released by "delete_volume" :: held 1.093s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Created reservations ['bdd38ed2-4144-446a-9279-391df078bf1f', '94f2b30f-8312-446b-be17-ddb284f45b7a', 'ab3b1a8d-6c42-40da-8c5b-2ee2331fa77b', '8f63c7cf-f1ab-4048-8155-a60358bb6093'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:27 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:06:27 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:28 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.328s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:28 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Deleted volume successfully. Nov 02 10:06:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ab0c63b3-fed5-4af4-a626-64e3dc80fe2b tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-1f8786dc-1bd2-452d-9168-8e55eda13aa3-delete_volume" released by "delete_volume" :: held 5.166s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-27dcb6d4-5111-428c-abaa-1164b434aa77-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-27dcb6d4-5111-428c-abaa-1164b434aa77-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "cinder-quobyte-27dcb6d4-5111-428c-abaa-1164b434aa77" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-27dcb6d4-5111-428c-abaa-1164b434aa77" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0eacd-14c0-4a95-9a00-760e22282f72]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:29 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 Nov 02 10:06:29 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:29 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77" returned: 0 in 0.431s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:29 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77 Nov 02 10:06:29 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:29 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-27dcb6d4-5111-428c-abaa-1164b434aa77" returned: 0 in 0.307s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-quobyte-27dcb6d4-5111-428c-abaa-1164b434aa77" released by "delete_volume" :: held 0.793s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Created reservations ['314bf9d0-ad1c-44aa-bf49-1bfc4d57643d', 'b9e05843-52e5-4f6b-8596-0ba7c2d9339f', 'ae634971-ff02-48e5-8acf-52869b18d276', 'a1e4be89-484e-4dec-9d52-5c630e45a479'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:30 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:06:30 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:30 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.332s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Deleted volume successfully. Nov 02 10:06:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f449125a-b292-426e-b748-2e2083d2a6c3 tempest-VolumesDeleteCascade-849311634 None] Lock "cinder-27dcb6d4-5111-428c-abaa-1164b434aa77-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:40 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:40 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:06:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:48 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:06:48 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:49 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.661s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:06:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:06:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Flow 'volume_create_manager' (71035c96-24f9-491d-a0c2-3ba9646cf9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e736d8-667d-4cbd-9a78-56ed3c3a875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e736d8-667d-4cbd-9a78-56ed3c3a875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1164932205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdaa432-5b60-4e08-8348-a7fb95bc9855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35327ecd9a499cb8fc5ba090091775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:04Z,use_quota=True,user_id='751ee92fc4ac4885a4981ca4f777e542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586730b2-513c-4d35-b9ce-097584e00af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586730b2-513c-4d35-b9ce-097584e00af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff9d17b-342c-4f7a-b209-4cc63907a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff9d17b-342c-4f7a-b209-4cc63907a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abdaa432-5b60-4e08-8348-a7fb95bc9855', 'volume_name': 'volume-abdaa432-5b60-4e08-8348-a7fb95bc9855', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2ae2e5-109b-4b0b-ace8-fb88e25199e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2ae2e5-109b-4b0b-ace8-fb88e25199e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cb30ce-f9e3-4f86-9c57-385d0ec6d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:03 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Volume abdaa432-5b60-4e08-8348-a7fb95bc9855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abdaa432-5b60-4e08-8348-a7fb95bc9855', 'volume_size': 1} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1164932205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdaa432-5b60-4e08-8348-a7fb95bc9855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da35327ecd9a499cb8fc5ba090091775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:04Z,use_quota=True,user_id='751ee92fc4ac4885a4981ca4f777e542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Creating volume abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:03 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:07:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:03 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 1073741824 Nov 02 10:07:03 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:04 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 1073741824" returned: 0 in 0.667s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:04 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:07:04 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:04 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.325s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cb30ce-f9e3-4f86-9c57-385d0ec6d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abdaa432-5b60-4e08-8348-a7fb95bc9855', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4b2d19-22a8-43d8-b423-0d0aaa82acd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:05 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Volume volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 (abdaa432-5b60-4e08-8348-a7fb95bc9855): created successfully Nov 02 10:07:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4b2d19-22a8-43d8-b423-0d0aaa82acd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Flow 'volume_create_manager' (71035c96-24f9-491d-a0c2-3ba9646cf9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0e396fa8-ba35-4662-92b7-e3bfeb0dd32e tempest-VolumesActionsTest-525162372 None] Created volume successfully. Nov 02 10:07:12 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Flow 'volume_create_manager' (8c812857-96dc-49c2-91da-0abc1e5a390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb80c1d-3f71-4569-a48c-f3188bfd395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb80c1d-3f71-4569-a48c-f3188bfd395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-424219535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00888f7-5a83-42c7-b298-134d4a46277e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15746f165501486e8dc1f2bc9ade944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:13Z,use_quota=True,user_id='06c9be5e70974ddba9dd9567c46e67d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2379ca34-4446-4695-a7cd-361aa67a0cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2379ca34-4446-4695-a7cd-361aa67a0cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542e1369-91dc-4262-9cdd-4d8b32ab5ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542e1369-91dc-4262-9cdd-4d8b32ab5ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00888f7-5a83-42c7-b298-134d4a46277e', 'volume_name': 'volume-d00888f7-5a83-42c7-b298-134d4a46277e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8726ab-5ae3-42a0-b5f6-9a900f59dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8726ab-5ae3-42a0-b5f6-9a900f59dc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02639822-2b56-4e50-8720-96b7f7b98285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Volume d00888f7-5a83-42c7-b298-134d4a46277e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00888f7-5a83-42c7-b298-134d4a46277e', 'volume_size': 1} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-424219535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00888f7-5a83-42c7-b298-134d4a46277e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15746f165501486e8dc1f2bc9ade944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:13Z,use_quota=True,user_id='06c9be5e70974ddba9dd9567c46e67d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Creating volume d00888f7-5a83-42c7-b298-134d4a46277e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:13 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:13 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e 1073741824 Nov 02 10:07:13 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Flow 'volume_create_manager' (e98c606e-49ae-4ca6-9386-221122e8fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54edf3a-eb56-4365-82dc-aeadd11cbabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54edf3a-eb56-4365-82dc-aeadd11cbabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1634017179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fb4b54-5f98-4a33-88d1-0f3c0aee677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24c55bd39b4cf68d51703a36c505b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:14Z,use_quota=True,user_id='439062614d054432b4418ff877280425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61bea80-6135-4c31-ac17-b0d23bc201e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61bea80-6135-4c31-ac17-b0d23bc201e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a2cfc3-2e08-4c83-a63f-91587a1fc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a2cfc3-2e08-4c83-a63f-91587a1fc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fb4b54-5f98-4a33-88d1-0f3c0aee677c', 'volume_name': 'volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e0a069-ffd9-41a0-9319-67bdfff140d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e0a069-ffd9-41a0-9319-67bdfff140d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ec496a-0535-4ca5-9ead-93d730751443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:13 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Volume 09fb4b54-5f98-4a33-88d1-0f3c0aee677c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c', 'volume_size': 1} Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:13 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e 1073741824" returned: 0 in 0.805s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:14 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e Nov 02 10:07:14 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:14 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e" returned: 0 in 0.472s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1634017179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fb4b54-5f98-4a33-88d1-0f3c0aee677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24c55bd39b4cf68d51703a36c505b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:14Z,use_quota=True,user_id='439062614d054432b4418ff877280425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Creating volume 09fb4b54-5f98-4a33-88d1-0f3c0aee677c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:14 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:14 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c 1073741824 Nov 02 10:07:14 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02639822-2b56-4e50-8720-96b7f7b98285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00888f7-5a83-42c7-b298-134d4a46277e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cde7de-deda-43c3-8e8e-e59d76e53d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:14 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Volume volume-d00888f7-5a83-42c7-b298-134d4a46277e (d00888f7-5a83-42c7-b298-134d4a46277e): created successfully Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cde7de-deda-43c3-8e8e-e59d76e53d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Flow 'volume_create_manager' (8c812857-96dc-49c2-91da-0abc1e5a390c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-dd506e6e-5552-4810-812e-956edf71b13f tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Created volume successfully. Nov 02 10:07:15 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c 1073741824" returned: 0 in 0.834s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:15 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c Nov 02 10:07:15 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:15 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c" returned: 0 in 0.435s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ec496a-0535-4ca5-9ead-93d730751443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2096c5-7019-4d87-80e1-324835d452b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:15 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Volume volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c (09fb4b54-5f98-4a33-88d1-0f3c0aee677c): created successfully Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2096c5-7019-4d87-80e1-324835d452b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Flow 'volume_create_manager' (e98c606e-49ae-4ca6-9386-221122e8fee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-aed9e19c-4f3f-49dc-80cd-1563485de0af tempest-AttachVolumeTestJSON-832289464 None] Created volume successfully. Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5f99a8d-4e65-4ed5-962f-29004f62789d tempest-VolumesActionsTest-525162372 None] Acquiring lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855" by "attach_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5f99a8d-4e65-4ed5-962f-29004f62789d tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855" acquired by "attach_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-956071b9-f81b-429f-96eb-bd290d77992d req-ac171119-394d-491b-8f44-57ab45eb80f4 tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-956071b9-f81b-429f-96eb-bd290d77992d req-ac171119-394d-491b-8f44-57ab45eb80f4 tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-956071b9-f81b-429f-96eb-bd290d77992d req-ac171119-394d-491b-8f44-57ab45eb80f4 tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e5f99a8d-4e65-4ed5-962f-29004f62789d tempest-VolumesActionsTest-525162372 None] Attaching volume abdaa432-5b60-4e08-8348-a7fb95bc9855 to instance 23d7340d-1a9a-4b9e-96e6-b7baac70579b at mountpoint /dev/vdb on host None. Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-956071b9-f81b-429f-96eb-bd290d77992d req-ac171119-394d-491b-8f44-57ab45eb80f4 tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-d00888f7-5a83-42c7-b298-134d4a46277e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca287153-875f-4a13-993f-2e316a24f6d8', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e5f99a8d-4e65-4ed5-962f-29004f62789d tempest-VolumesActionsTest-525162372 None] Attach volume completed successfully. Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e5f99a8d-4e65-4ed5-962f-29004f62789d tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855" released by "attach_volume" :: held 0.139s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-956071b9-f81b-429f-96eb-bd290d77992d req-ac171119-394d-491b-8f44-57ab45eb80f4 tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] attachment_update completed successfully. Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a4e5d683-f04f-47df-a5c1-9387ed6cfbed tempest-VolumesActionsTest-525162372 None] Acquiring lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-detach_volume" by "detach_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a4e5d683-f04f-47df-a5c1-9387ed6cfbed tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a4e5d683-f04f-47df-a5c1-9387ed6cfbed tempest-VolumesActionsTest-525162372 None] Detaching volume abdaa432-5b60-4e08-8348-a7fb95bc9855 from instance 23d7340d-1a9a-4b9e-96e6-b7baac70579b. Nov 02 10:07:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a4e5d683-f04f-47df-a5c1-9387ed6cfbed tempest-VolumesActionsTest-525162372 None] Detach volume completed successfully. Nov 02 10:07:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a4e5d683-f04f-47df-a5c1-9387ed6cfbed tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-138b3c2d-da52-4e9e-82d2-2a7dab45f5cd req-b477c040-b6c9-442f-ae56-c5a82ddf194a tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-138b3c2d-da52-4e9e-82d2-2a7dab45f5cd req-b477c040-b6c9-442f-ae56-c5a82ddf194a tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-138b3c2d-da52-4e9e-82d2-2a7dab45f5cd req-b477c040-b6c9-442f-ae56-c5a82ddf194a tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-138b3c2d-da52-4e9e-82d2-2a7dab45f5cd req-b477c040-b6c9-442f-ae56-c5a82ddf194a tempest-AttachVolumeTestJSON-832289464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c032029-2403-424e-ab26-8a78206ce1a0', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-138b3c2d-da52-4e9e-82d2-2a7dab45f5cd req-b477c040-b6c9-442f-ae56-c5a82ddf194a tempest-AttachVolumeTestJSON-832289464 None] attachment_update completed successfully. Nov 02 10:07:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-fb6a8c54-9624-4da8-bcc8-f4dffb4ec543 req-9a6fdc36-21e7-4622-bf9e-bd27ada22640 tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Terminate volume connection completed successfully. Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-fb6a8c54-9624-4da8-bcc8-f4dffb4ec543 req-9a6fdc36-21e7-4622-bf9e-bd27ada22640 tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Deleting attachment ca287153-875f-4a13-993f-2e316a24f6d8. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Flow 'volume_create_manager' (bfbea933-16b6-4a0a-9ded-4eaeb6708392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ff1d5a-2ddb-4cb4-a4a4-cf0501ec79b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ff1d5a-2ddb-4cb4-a4a4-cf0501ec79b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1061604359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59886582-2a56-485c-b170-b8ef4a7e56ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24c55bd39b4cf68d51703a36c505b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:21Z,use_quota=True,user_id='439062614d054432b4418ff877280425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b692c53d-8e6e-4771-aa15-0b5788056a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b692c53d-8e6e-4771-aa15-0b5788056a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9584fe58-e104-4266-a298-ef721e408b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9584fe58-e104-4266-a298-ef721e408b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59886582-2a56-485c-b170-b8ef4a7e56ec', 'volume_name': 'volume-59886582-2a56-485c-b170-b8ef4a7e56ec', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c54145-a465-4cab-ba22-d4a8dc28d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c54145-a465-4cab-ba22-d4a8dc28d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b542203-1fba-499c-b1a7-d07bc4323a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:20 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Volume 59886582-2a56-485c-b170-b8ef4a7e56ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59886582-2a56-485c-b170-b8ef4a7e56ec', 'volume_size': 1} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1061604359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59886582-2a56-485c-b170-b8ef4a7e56ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24c55bd39b4cf68d51703a36c505b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:21Z,use_quota=True,user_id='439062614d054432b4418ff877280425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Creating volume 59886582-2a56-485c-b170-b8ef4a7e56ec {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:20 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:07:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:20 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec 1073741824 Nov 02 10:07:20 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Acquiring lock "cinder-d00888f7-5a83-42c7-b298-134d4a46277e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "cinder-d00888f7-5a83-42c7-b298-134d4a46277e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Acquiring lock "cinder-quobyte-d00888f7-5a83-42c7-b298-134d4a46277e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "cinder-quobyte-d00888f7-5a83-42c7-b298-134d4a46277e" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d18476-d38c-4f75-b193-4981f00b0516]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:21 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e Nov 02 10:07:21 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:21 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec 1073741824" returned: 0 in 0.585s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:21 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec Nov 02 10:07:21 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:21 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec" returned: 0 in 0.279s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b542203-1fba-499c-b1a7-d07bc4323a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59886582-2a56-485c-b170-b8ef4a7e56ec', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a3d2f8-0721-4ce4-a002-2c02d229ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:21 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Volume volume-59886582-2a56-485c-b170-b8ef4a7e56ec (59886582-2a56-485c-b170-b8ef4a7e56ec): created successfully Nov 02 10:07:21 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a3d2f8-0721-4ce4-a002-2c02d229ae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Flow 'volume_create_manager' (bfbea933-16b6-4a0a-9ded-4eaeb6708392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e" returned: 0 in 0.514s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2ddf161f-e9f2-4cfe-a544-980c15f02471 tempest-AttachVolumeTestJSON-832289464 None] Created volume successfully. Nov 02 10:07:21 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e Nov 02 10:07:21 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:22 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d00888f7-5a83-42c7-b298-134d4a46277e" returned: 0 in 0.255s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "cinder-quobyte-d00888f7-5a83-42c7-b298-134d4a46277e" released by "delete_volume" :: held 0.814s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Created reservations ['a5f487a7-6ee5-4b8b-8997-4b3cbbb1b872', 'c752bef1-89a4-48b3-9f96-51d2609892e9', '9971317f-2792-4b1b-9177-f978b35abb0d', '9b60ae07-935c-44b5-adb4-041efd7a9920'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:22 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:07:22 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:22 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.316s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Deleted volume successfully. Nov 02 10:07:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ada5938a-332b-4be1-9406-96fdccc4c39d tempest-TestServerVolumeAttachScenarioOldVersion-1576912269 None] Lock "cinder-d00888f7-5a83-42c7-b298-134d4a46277e-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d3fd7302-4bc6-4ef4-9c98-a5e8514587b5 req-fbec111b-8425-4a8e-84fc-5d883269f0c9 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d3fd7302-4bc6-4ef4-9c98-a5e8514587b5 req-fbec111b-8425-4a8e-84fc-5d883269f0c9 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d3fd7302-4bc6-4ef4-9c98-a5e8514587b5 req-fbec111b-8425-4a8e-84fc-5d883269f0c9 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-d3fd7302-4bc6-4ef4-9c98-a5e8514587b5 req-fbec111b-8425-4a8e-84fc-5d883269f0c9 tempest-AttachVolumeTestJSON-832289464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-59886582-2a56-485c-b170-b8ef4a7e56ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '165d28fc-9dee-4d57-a5a3-7b9466fc9953', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-d3fd7302-4bc6-4ef4-9c98-a5e8514587b5 req-fbec111b-8425-4a8e-84fc-5d883269f0c9 tempest-AttachVolumeTestJSON-832289464 None] attachment_update completed successfully. Nov 02 10:07:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-0d51a53b-4cab-4f87-8bcc-a6c7b86ba520 req-90676c27-f966-49ce-8e67-80537c39eacd tempest-AttachVolumeTestJSON-832289464 None] Terminate volume connection completed successfully. Nov 02 10:07:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0d51a53b-4cab-4f87-8bcc-a6c7b86ba520 req-90676c27-f966-49ce-8e67-80537c39eacd tempest-AttachVolumeTestJSON-832289464 None] Deleting attachment 0c032029-2403-424e-ab26-8a78206ce1a0. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Flow 'volume_create_manager' (a4fc8062-55bf-45f3-ab51-c6ea788549b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfee83a-974d-4b2b-938c-9f67dcfdf8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfee83a-974d-4b2b-938c-9f67dcfdf8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-503671545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2daacf-379e-42ad-bc64-2dbc96c642a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8edb5632a724aa6804b9170f5224673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:29Z,use_quota=True,user_id='e505b67ced544b70a3190bf1f0af9a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320e9801-f90c-4ec4-aec4-a33964599137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320e9801-f90c-4ec4-aec4-a33964599137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cda5e72-96ce-4809-9533-7204dc9a5f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cda5e72-96ce-4809-9533-7204dc9a5f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2daacf-379e-42ad-bc64-2dbc96c642a9', 'volume_name': 'volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f77732f-eca7-4e73-bf72-825d2ea6fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f77732f-eca7-4e73-bf72-825d2ea6fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82fca87-3c0b-47c5-a009-9bbdd0ad0fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Volume fc2daacf-379e-42ad-bc64-2dbc96c642a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9', 'volume_size': 1} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-503671545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2daacf-379e-42ad-bc64-2dbc96c642a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8edb5632a724aa6804b9170f5224673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:29Z,use_quota=True,user_id='e505b67ced544b70a3190bf1f0af9a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Creating volume fc2daacf-379e-42ad-bc64-2dbc96c642a9 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:29 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:29 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 1073741824 Nov 02 10:07:29 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-2770c682-2b60-4501-b63b-67b93b06fc28 req-5f4104f0-6111-4e2a-a102-7f24372a718b tempest-AttachVolumeTestJSON-832289464 None] Terminate volume connection completed successfully. Nov 02 10:07:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-2770c682-2b60-4501-b63b-67b93b06fc28 req-5f4104f0-6111-4e2a-a102-7f24372a718b tempest-AttachVolumeTestJSON-832289464 None] Deleting attachment 165d28fc-9dee-4d57-a5a3-7b9466fc9953. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:07:30 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 1073741824" returned: 0 in 0.868s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:30 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 Nov 02 10:07:30 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-782be7e1-ba85-4b79-b70d-416575cdb211 tempest-VolumesActionsTest-525162372 None] Acquiring lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855" by "attach_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-782be7e1-ba85-4b79-b70d-416575cdb211 tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855" acquired by "attach_volume" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-782be7e1-ba85-4b79-b70d-416575cdb211 tempest-VolumesActionsTest-525162372 None] Attaching volume abdaa432-5b60-4e08-8348-a7fb95bc9855 to instance 8dcf0cb2-daa2-4ca9-b09f-dc6104754b9d at mountpoint /dev/vdb on host None. Nov 02 10:07:31 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-782be7e1-ba85-4b79-b70d-416575cdb211 tempest-VolumesActionsTest-525162372 None] Attach volume completed successfully. Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9" returned: 0 in 0.660s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-782be7e1-ba85-4b79-b70d-416575cdb211 tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855" released by "attach_volume" :: held 0.232s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82fca87-3c0b-47c5-a009-9bbdd0ad0fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7b5a48-c705-4a63-b3ee-e617f793de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:31 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Volume volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 (fc2daacf-379e-42ad-bc64-2dbc96c642a9): created successfully Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7b5a48-c705-4a63-b3ee-e617f793de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Flow 'volume_create_manager' (a4fc8062-55bf-45f3-ab51-c6ea788549b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-79cbc335-768f-42cb-b11a-55a8d3bb504a tempest-AttachVolumeNegativeTest-801015686 None] Created volume successfully. Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-df9c1a7e-3708-4450-8993-828e54a4dacb tempest-VolumesActionsTest-525162372 None] Acquiring lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-detach_volume" by "detach_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-df9c1a7e-3708-4450-8993-828e54a4dacb tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-df9c1a7e-3708-4450-8993-828e54a4dacb tempest-VolumesActionsTest-525162372 None] Detaching volume abdaa432-5b60-4e08-8348-a7fb95bc9855 from instance 8dcf0cb2-daa2-4ca9-b09f-dc6104754b9d. Nov 02 10:07:32 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-df9c1a7e-3708-4450-8993-828e54a4dacb tempest-VolumesActionsTest-525162372 None] Detach volume completed successfully. Nov 02 10:07:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-df9c1a7e-3708-4450-8993-828e54a4dacb tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-299a2c80-7b44-43ac-bed4-2fd35df1926e req-ab4e72d4-05bd-4bbf-ab61-78011115a1ee tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-299a2c80-7b44-43ac-bed4-2fd35df1926e req-ab4e72d4-05bd-4bbf-ab61-78011115a1ee tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-299a2c80-7b44-43ac-bed4-2fd35df1926e req-ab4e72d4-05bd-4bbf-ab61-78011115a1ee tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-299a2c80-7b44-43ac-bed4-2fd35df1926e req-ab4e72d4-05bd-4bbf-ab61-78011115a1ee tempest-AttachVolumeNegativeTest-801015686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06066451-798d-4518-b105-dc0f294c03b3', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-299a2c80-7b44-43ac-bed4-2fd35df1926e req-ab4e72d4-05bd-4bbf-ab61-78011115a1ee tempest-AttachVolumeNegativeTest-801015686 None] attachment_update completed successfully. Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "cinder-59886582-2a56-485c-b170-b8ef4a7e56ec-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-59886582-2a56-485c-b170-b8ef4a7e56ec-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "cinder-quobyte-59886582-2a56-485c-b170-b8ef4a7e56ec" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-quobyte-59886582-2a56-485c-b170-b8ef4a7e56ec" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d9fbbb-277c-418e-849a-9b69eca6930f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:39 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec Nov 02 10:07:39 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:39 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec" returned: 0 in 0.472s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:39 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec Nov 02 10:07:39 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d403b80-1261-4bda-90a0-021e698881f8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:40 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:07:40 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:40 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-59886582-2a56-485c-b170-b8ef4a7e56ec" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-quobyte-59886582-2a56-485c-b170-b8ef4a7e56ec" released by "delete_volume" :: held 0.967s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Created reservations ['df15d1b1-4d6e-4888-b932-07dd4dee5410', '5106a323-8c14-4bc1-99ce-a537dc392b37', 'a93d7b2a-9b9b-4e0d-afbf-4dad47381c43', '0dac4667-6bc4-4b87-ab61-88c94f903e74'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:40 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:07:40 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "cinder-09fb4b54-5f98-4a33-88d1-0f3c0aee677c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:40 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.677s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-09fb4b54-5f98-4a33-88d1-0f3c0aee677c-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530c812-b2fd-47d0-9613-a564d6c0e81c]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "cinder-quobyte-09fb4b54-5f98-4a33-88d1-0f3c0aee677c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-quobyte-09fb4b54-5f98-4a33-88d1-0f3c0aee677c" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[926860e3-c1c3-4c57-a6bd-053a9cd15985]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:40 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:07:40 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:40 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.523s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:40 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:40 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c Nov 02 10:07:40 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Deleted volume successfully. Nov 02 10:07:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-14346bb6-9e21-4646-95c7-294d319f80a3 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-59886582-2a56-485c-b170-b8ef4a7e56ec-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:41 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.611s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.bd982750-8db7-4c9d-89dd-7b2271216ec2cct06zoc.img {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:41 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.bd982750-8db7-4c9d-89dd-7b2271216ec2cct06zoc.img Nov 02 10:07:41 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:41 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c" returned: 0 in 0.598s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:41 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c Nov 02 10:07:41 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:41 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-09fb4b54-5f98-4a33-88d1-0f3c0aee677c" returned: 0 in 0.339s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-quobyte-09fb4b54-5f98-4a33-88d1-0f3c0aee677c" released by "delete_volume" :: held 1.019s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:42 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Created reservations ['bdbbf047-4bb2-404b-9bc6-8597403413af', 'b3c49d68-8256-4346-b576-0fa9e0b2f04e', '3c911407-8120-46ff-ac5f-c4c9be95a0f9', 'caf508c9-e5e7-4719-87af-ddeaf698d190'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:42 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:07:42 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:43 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.776s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:43 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Deleted volume successfully. Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fc175548-0799-4b39-9a76-e8212862c94c tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-09fb4b54-5f98-4a33-88d1-0f3c0aee677c-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "cinder-8f4a7a29-4a27-4675-8ae6-726bd2668a61-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-8f4a7a29-4a27-4675-8ae6-726bd2668a61-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "cinder-quobyte-8f4a7a29-4a27-4675-8ae6-726bd2668a61" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-quobyte-8f4a7a29-4a27-4675-8ae6-726bd2668a61" acquired by "delete_volume" :: waited 0.037s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd3012a-04a8-4a3c-9087-f60823dbed45]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:44 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 Nov 02 10:07:44 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:44 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61" returned: 0 in 1.205s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:45 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61 Nov 02 10:07:45 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:45 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f4a7a29-4a27-4675-8ae6-726bd2668a61" returned: 0 in 0.732s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-quobyte-8f4a7a29-4a27-4675-8ae6-726bd2668a61" released by "delete_volume" :: held 2.098s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:45 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Created reservations ['8d769e34-1e9a-492c-984d-bd5fe8f962f1', 'ef57c7db-19af-42fe-9676-d147aba148ed', 'abdbf18e-b94e-4867-9b4c-9b2b358d00f2', 'd8476892-068c-4c03-97d4-4f61fdd3131a'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:46 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:07:46 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:46 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.697s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Deleted volume successfully. Nov 02 10:07:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-953c8828-7199-44ae-bde5-ccc158829478 tempest-AttachVolumeTestJSON-832289464 None] Lock "cinder-8f4a7a29-4a27-4675-8ae6-726bd2668a61-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:07:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:48 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:07:48 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:49 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.695s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:07:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:07:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:07:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.bd982750-8db7-4c9d-89dd-7b2271216ec2cct06zoc.img" returned: 0 in 10.857s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:52 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd97c74-36a7-4f1e-9514-3373b5f497c7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:52 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:07:52 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 1.049s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:53 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855, size 1024.00 MB, duration 10.86 sec, destination /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.bd982750-8db7-4c9d-89dd-7b2271216ec2cct06zoc.img {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:07:53 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Converted 1024.00 MB image at 94.30 MB/s Nov 02 10:07:53 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] bd982750-8db7-4c9d-89dd-7b2271216ec2 was raw, no need to convert to raw {{(pid=87005) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:08:03 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=75,cinder:INSERT=10,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:03 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=65,cinder:SELECT=73,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Flow 'volume_create_manager' (6956c17c-b60b-4173-b45a-c5754a736077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdf1142-e43b-439a-b241-42e3502d293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdf1142-e43b-439a-b241-42e3502d293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1333206890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f43804-7a9c-4d3f-b16f-28d6a98cfcbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92134e311424fd891a8cd5cce2a81a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:09Z,use_quota=True,user_id='915e2ef0e7f0437db43cd22d427b3802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7490f7e1-c4ec-48bc-81ae-6f0a754f2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7490f7e1-c4ec-48bc-81ae-6f0a754f2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90467a00-717a-44f2-b0c4-65513669da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90467a00-717a-44f2-b0c4-65513669da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f43804-7a9c-4d3f-b16f-28d6a98cfcbb', 'volume_name': 'volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b0976d-5f1d-4a4e-a9e9-5ea245a9af69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b0976d-5f1d-4a4e-a9e9-5ea245a9af69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6350775-4a87-4468-92e1-7003eeac10f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:08 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Volume 77f43804-7a9c-4d3f-b16f-28d6a98cfcbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb', 'volume_size': 1} Nov 02 10:08:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:18 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:18 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 44.550s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Uploaded volume to glance image-id: bd982750-8db7-4c9d-89dd-7b2271216ec2. {{(pid=87005) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.603s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1333206890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f43804-7a9c-4d3f-b16f-28d6a98cfcbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92134e311424fd891a8cd5cce2a81a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:09Z,use_quota=True,user_id='915e2ef0e7f0437db43cd22d427b3802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Creating volume 77f43804-7a9c-4d3f-b16f-28d6a98cfcbb {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:24 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:08:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-baf3b559-88bb-49b8-8afd-c67e55f83597 tempest-VolumesActionsTest-525162372 None] Copy volume to image completed successfully. Nov 02 10:08:24 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb 1073741824 Nov 02 10:08:24 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:25 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb 1073741824" returned: 0 in 0.711s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:25 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb Nov 02 10:08:25 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:25 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb" returned: 0 in 0.417s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6350775-4a87-4468-92e1-7003eeac10f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5195054-7498-4ae0-9e8e-26ac0ee91fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Volume volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb (77f43804-7a9c-4d3f-b16f-28d6a98cfcbb): created successfully Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5195054-7498-4ae0-9e8e-26ac0ee91fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Flow 'volume_create_manager' (6956c17c-b60b-4173-b45a-c5754a736077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0fb96dd3-ceea-4eb3-af09-e64d98a5c771 tempest-VolumesTestJSON-1996753585 None] Created volume successfully. Nov 02 10:08:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fda7a8-07ff-4537-b238-136f3692fdea]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:26 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:08:26 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Flow 'volume_create_manager' (573828f8-7991-4b11-82b1-5566521b78f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:27 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcb1c06-5c1f-4781-ae33-386c381a5d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.788s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcb1c06-5c1f-4781-ae33-386c381a5d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1850349101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6d405a-dd8f-4b57-bee5-75123c44cd61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92134e311424fd891a8cd5cce2a81a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:27Z,use_quota=True,user_id='915e2ef0e7f0437db43cd22d427b3802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9595eb82-998c-4709-bf56-a23eddd6ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9595eb82-998c-4709-bf56-a23eddd6ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b84c8c-50ae-419b-a4db-751f484b1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b84c8c-50ae-419b-a4db-751f484b1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6d405a-dd8f-4b57-bee5-75123c44cd61', 'volume_name': 'volume-df6d405a-dd8f-4b57-bee5-75123c44cd61', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15ec06b-ac6e-44ba-9ef7-aa5db8e9f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15ec06b-ac6e-44ba-9ef7-aa5db8e9f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa33e59-d597-4441-9a3d-f8ec3a214d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Volume df6d405a-dd8f-4b57-bee5-75123c44cd61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6d405a-dd8f-4b57-bee5-75123c44cd61', 'volume_size': 1} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9a7ea1-257a-414d-8129-26825ff23d58]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:27 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:08:27 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:27 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.467s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:27 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img Nov 02 10:08:27 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Flow 'volume_create_manager' (af6256d0-9bcc-4510-8416-a71fd5fd50ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2b02ae-13a5-47d4-a8ce-5beee9704342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2b02ae-13a5-47d4-a8ce-5beee9704342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-310944833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94ea9a1-6342-4238-957b-c2ee036c5fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f8866aeb144919a4e311d5518a66f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:28Z,use_quota=True,user_id='8d4e2ef16eb14e4b9f8f7fe3865bca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a578390-7f4e-43fe-8a8f-772bd03e08ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a578390-7f4e-43fe-8a8f-772bd03e08ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8146f522-dd34-4573-9040-64bc2b57130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8146f522-dd34-4573-9040-64bc2b57130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e94ea9a1-6342-4238-957b-c2ee036c5fb0', 'volume_name': 'volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bf8074-3ed5-42ce-8453-46833f3fef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bf8074-3ed5-42ce-8453-46833f3fef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc8ef1c-2577-4f2e-a5a6-69acbccbb4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:28 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Volume e94ea9a1-6342-4238-957b-c2ee036c5fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0', 'volume_size': 1} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Flow 'volume_create_manager' (7454d039-2785-4663-a6c2-968a8148c308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ed6570-665f-453d-9cea-3d55d4055f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ed6570-665f-453d-9cea-3d55d4055f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1469642709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bcf399-2670-4c82-8bea-5e6406c64d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f8866aeb144919a4e311d5518a66f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:29Z,use_quota=True,user_id='8d4e2ef16eb14e4b9f8f7fe3865bca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14607454-45fe-48df-b680-4b465278393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14607454-45fe-48df-b680-4b465278393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6383f64-d834-4363-afd4-0d6887680672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6383f64-d834-4363-afd4-0d6887680672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18bcf399-2670-4c82-8bea-5e6406c64d10', 'volume_name': 'volume-18bcf399-2670-4c82-8bea-5e6406c64d10', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f03c1-89c0-4f2e-b66c-61b35bc97de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f03c1-89c0-4f2e-b66c-61b35bc97de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5f6458-4478-4e0e-8bd0-eab8fa400da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Volume 18bcf399-2670-4c82-8bea-5e6406c64d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18bcf399-2670-4c82-8bea-5e6406c64d10', 'volume_size': 1} Nov 02 10:08:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-99253331-37a2-491d-af18-cb870ad25f93 req-8527e0c4-104a-4c5d-9c6f-d763523fb538 tempest-AttachVolumeNegativeTest-801015686 None] Terminate volume connection completed successfully. Nov 02 10:08:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-99253331-37a2-491d-af18-cb870ad25f93 req-8527e0c4-104a-4c5d-9c6f-d763523fb538 tempest-AttachVolumeNegativeTest-801015686 None] Deleting attachment 06066451-798d-4518-b105-dc0f294c03b3. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:08:36 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img" returned: 0 in 9.000s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:36 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f5c2b4-6242-491a-8ccb-17ff00d4f6bd]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:37 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:08:37 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:37 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.712s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:37 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:08:37 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Converted 1024.00 MB image at 113.75 MB/s Nov 02 10:08:37 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] 01cfc907-9edf-41aa-80a1-6cdfc2762095 was raw, converting to qcow2 {{(pid=87005) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 10:08:37 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe86f24c-bf97-4f57-b9bc-c2a3cd0de5cb]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:37 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img Nov 02 10:08:37 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:38 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img" returned: 0 in 0.522s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:38 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img Nov 02 10:08:38 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:38 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img" returned: 1 in 0.492s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:08:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img /opt/stack/data/cinder/conversion/vol_upload_ige1op8p {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:38 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img /opt/stack/data/cinder/conversion/vol_upload_ige1op8p Nov 02 10:08:38 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:39 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img /opt/stack/data/cinder/conversion/vol_upload_ige1op8p" returned: 0 in 0.358s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:39 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Image conversion details: src /opt/stack/data/cinder/conversion/abdaa432-5b60-4e08-8348-a7fb95bc9855.temp_image.01cfc907-9edf-41aa-80a1-6cdfc2762095fa8o4mok.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ige1op8p {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:08:39 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 10:08:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[67031fc9-db8a-4506-a28d-eeacb3423c7a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ige1op8p {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:39 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ige1op8p Nov 02 10:08:39 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:39 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ige1op8p" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:40 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.046s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Uploaded volume to glance image-id: 01cfc907-9edf-41aa-80a1-6cdfc2762095. {{(pid=87005) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.176s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1850349101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6d405a-dd8f-4b57-bee5-75123c44cd61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92134e311424fd891a8cd5cce2a81a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:27Z,use_quota=True,user_id='915e2ef0e7f0437db43cd22d427b3802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Creating volume df6d405a-dd8f-4b57-bee5-75123c44cd61 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:41 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:08:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:41 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 1073741824 Nov 02 10:08:41 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-09ff3a64-0cbb-4a6b-b4bd-8d2deae0af05 tempest-VolumesActionsTest-525162372 None] Copy volume to image completed successfully. Nov 02 10:08:42 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 1073741824" returned: 0 in 0.808s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:42 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 Nov 02 10:08:42 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:43 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61" returned: 0 in 0.543s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.793s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-310944833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94ea9a1-6342-4238-957b-c2ee036c5fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f8866aeb144919a4e311d5518a66f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:28Z,use_quota=True,user_id='8d4e2ef16eb14e4b9f8f7fe3865bca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Creating volume e94ea9a1-6342-4238-957b-c2ee036c5fb0 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:43 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa33e59-d597-4441-9a3d-f8ec3a214d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6d405a-dd8f-4b57-bee5-75123c44cd61', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcaaa32-c293-4d16-9b14-f98de0ee0974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:43 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 1073741824 Nov 02 10:08:43 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:43 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Volume volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 (df6d405a-dd8f-4b57-bee5-75123c44cd61): created successfully Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcaaa32-c293-4d16-9b14-f98de0ee0974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Flow 'volume_create_manager' (573828f8-7991-4b11-82b1-5566521b78f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:43 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-36344bce-c9ca-407f-80db-62085e2e54b2 tempest-VolumesTestJSON-1996753585 None] Created volume successfully. Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Acquiring lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Acquiring lock "cinder-quobyte-abdaa432-5b60-4e08-8348-a7fb95bc9855" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Lock "cinder-quobyte-abdaa432-5b60-4e08-8348-a7fb95bc9855" acquired by "delete_volume" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebea12b0-ea04-4de5-880f-c26ad0f3d06c]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:44 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:08:44 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:44 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 1073741824" returned: 0 in 1.011s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:44 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 Nov 02 10:08:44 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:44 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.743s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:44 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855 Nov 02 10:08:44 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:44 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0" returned: 0 in 0.577s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.820s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1469642709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bcf399-2670-4c82-8bea-5e6406c64d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f8866aeb144919a4e311d5518a66f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:29Z,use_quota=True,user_id='8d4e2ef16eb14e4b9f8f7fe3865bca18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Creating volume 18bcf399-2670-4c82-8bea-5e6406c64d10 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:44 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:44 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 1073741824 Nov 02 10:08:44 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc8ef1c-2577-4f2e-a5a6-69acbccbb4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c0b94a-f73e-4d39-897b-5f8a89f33b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Volume volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 (e94ea9a1-6342-4238-957b-c2ee036c5fb0): created successfully Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c0b94a-f73e-4d39-897b-5f8a89f33b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Flow 'volume_create_manager' (af6256d0-9bcc-4510-8416-a71fd5fd50ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d5e6262e-2235-4d6f-a6b7-544af157a056 tempest-TestServerVolumeAttachmentScenario-4958076 None] Created volume successfully. Nov 02 10:08:45 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-abdaa432-5b60-4e08-8348-a7fb95bc9855" returned: 0 in 0.637s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Lock "cinder-quobyte-abdaa432-5b60-4e08-8348-a7fb95bc9855" released by "delete_volume" :: held 1.499s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Created reservations ['97512b20-2c2d-48be-9c4e-f634e9ded47e', 'f34f1e7c-544e-4c39-a617-6d70742e24c7', 'c9a54c9c-3718-4b3d-98e1-9ae61edebba5', 'c6460b50-ef0d-4c5f-968a-f6b3f8006db8'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Flow 'volume_create_manager' (ae18194d-9fcd-476d-ae0c-89881b2604db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141ef48b-6b07-4475-ae9f-5c4ef61a0222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:45 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:08:45 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141ef48b-6b07-4475-ae9f-5c4ef61a0222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-198562749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47090f73-fd2d-4944-bbe1-af9ae4b6207c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92134e311424fd891a8cd5cce2a81a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:46Z,use_quota=True,user_id='915e2ef0e7f0437db43cd22d427b3802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:45 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051e954c-2af1-4781-bfa3-0fcbe7f2335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051e954c-2af1-4781-bfa3-0fcbe7f2335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2995db8-d41f-41f4-b76a-cbad789e85d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2995db8-d41f-41f4-b76a-cbad789e85d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47090f73-fd2d-4944-bbe1-af9ae4b6207c', 'volume_name': 'volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b87d590-53a7-46fb-b364-23c03203492c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b87d590-53a7-46fb-b364-23c03203492c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db0db15-f486-40a1-86bf-15dd38746727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Volume 47090f73-fd2d-4944-bbe1-af9ae4b6207c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c', 'volume_size': 1} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 1073741824" returned: 0 in 1.116s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:46 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 Nov 02 10:08:46 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:46 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.477s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Deleted volume successfully. Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6950da09-f11e-431b-ac3b-f6c85fd112a3 tempest-VolumesActionsTest-525162372 None] Lock "cinder-abdaa432-5b60-4e08-8348-a7fb95bc9855-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:46 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10" returned: 0 in 0.486s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-198562749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47090f73-fd2d-4944-bbe1-af9ae4b6207c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b92134e311424fd891a8cd5cce2a81a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:46Z,use_quota=True,user_id='915e2ef0e7f0437db43cd22d427b3802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Creating volume 47090f73-fd2d-4944-bbe1-af9ae4b6207c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:46 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5f6458-4478-4e0e-8bd0-eab8fa400da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bcf399-2670-4c82-8bea-5e6406c64d10', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c7d399-fea4-4d7f-885d-8956e550e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:46 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c 1073741824 Nov 02 10:08:46 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Volume volume-18bcf399-2670-4c82-8bea-5e6406c64d10 (18bcf399-2670-4c82-8bea-5e6406c64d10): created successfully Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c7d399-fea4-4d7f-885d-8956e550e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Flow 'volume_create_manager' (7454d039-2785-4663-a6c2-968a8148c308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6fad8d4e-e066-435c-969b-4c63bd73eddf tempest-TestServerVolumeAttachmentScenario-4958076 None] Created volume successfully. Nov 02 10:08:47 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c 1073741824" returned: 0 in 1.032s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:47 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c Nov 02 10:08:47 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:48 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c" returned: 0 in 0.457s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db0db15-f486-40a1-86bf-15dd38746727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8d08f3-78ef-4ed4-ba7c-301cb1229440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:48 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Volume volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c (47090f73-fd2d-4944-bbe1-af9ae4b6207c): created successfully Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8d08f3-78ef-4ed4-ba7c-301cb1229440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Flow 'volume_create_manager' (ae18194d-9fcd-476d-ae0c-89881b2604db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-117d8645-4d29-4757-b64a-4a54ed4a8cce tempest-VolumesTestJSON-1996753585 None] Created volume successfully. Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:48 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:08:48 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:49 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.594s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:08:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:08:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:08:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "cinder-47090f73-fd2d-4944-bbe1-af9ae4b6207c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-47090f73-fd2d-4944-bbe1-af9ae4b6207c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "cinder-quobyte-47090f73-fd2d-4944-bbe1-af9ae4b6207c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-quobyte-47090f73-fd2d-4944-bbe1-af9ae4b6207c" acquired by "delete_volume" :: waited 0.052s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd2d409-456a-47f2-8cd1-c8d605d8c6d1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:50 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c Nov 02 10:08:50 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:51 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c" returned: 0 in 0.655s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:51 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c Nov 02 10:08:51 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:51 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47090f73-fd2d-4944-bbe1-af9ae4b6207c" returned: 0 in 0.328s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-quobyte-47090f73-fd2d-4944-bbe1-af9ae4b6207c" released by "delete_volume" :: held 1.060s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Created reservations ['4309b374-dacc-46e1-a34c-64e658c69f20', '1945108a-3eef-4f6f-9d5c-17f6eb55530f', '9ceefc47-57da-4877-b7b6-4cf15be058b4', '7477e5d6-1390-4e1c-b714-80fa92a4fd2b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:51 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:08:51 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:52 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.457s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:52 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Deleted volume successfully. Nov 02 10:08:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b0c1d942-dfe6-4c58-9072-39fad9766215 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-47090f73-fd2d-4944-bbe1-af9ae4b6207c-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Acquiring lock "cinder-df6d405a-dd8f-4b57-bee5-75123c44cd61-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Lock "cinder-df6d405a-dd8f-4b57-bee5-75123c44cd61-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Acquiring lock "cinder-quobyte-df6d405a-dd8f-4b57-bee5-75123c44cd61" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Lock "cinder-quobyte-df6d405a-dd8f-4b57-bee5-75123c44cd61" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:53 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664586f-9f01-4321-82e7-303398ecf029]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:53 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 Nov 02 10:08:53 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:54 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61" returned: 0 in 0.950s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:54 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61 Nov 02 10:08:54 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:54 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-df6d405a-dd8f-4b57-bee5-75123c44cd61" returned: 0 in 0.499s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Lock "cinder-quobyte-df6d405a-dd8f-4b57-bee5-75123c44cd61" released by "delete_volume" :: held 1.590s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:54 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Created reservations ['702c45cf-dcc8-498c-bf8f-c3877dba9a24', '80fbd4e6-cdfc-4896-a2fb-79cf7e7d2126', '9a3e4fb4-9245-4590-999f-d2c22b63c93f', '7b7b400c-bf9b-4144-8b53-fe01e2da0e81'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:55 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:08:55 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "cinder-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:55 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.523s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Deleted volume successfully. Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "cinder-quobyte-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a34af702-0d10-4e71-875e-b445551beafb tempest-VolumesTestJSON-1996753585 None] Lock "cinder-df6d405a-dd8f-4b57-bee5-75123c44cd61-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-quobyte-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb" acquired by "delete_volume" :: waited 0.046s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4bae5-5b14-4fba-9aad-7e79bee32219]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:55 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb Nov 02 10:08:55 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:56 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb" returned: 0 in 0.696s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:56 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb Nov 02 10:08:56 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:57 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb" returned: 0 in 0.498s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-quobyte-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb" released by "delete_volume" :: held 1.277s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Created reservations ['da9547d6-0670-4c50-94f9-59d0ed5142ed', 'f5d23cb7-4089-46b5-8237-689b2b069464', '31dfacc3-16e5-404d-b1b3-6701615e630b', '310d3fa3-dc1e-4f89-a06f-7a4ed288372c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:57 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:08:57 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:57 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.321s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Deleted volume successfully. Nov 02 10:08:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62a80184-1cf6-4f49-9773-d2895cacf7f1 tempest-VolumesTestJSON-1996753585 None] Lock "cinder-77f43804-7a9c-4d3f-b16f-28d6a98cfcbb-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Flow 'volume_create_manager' (c91a89c6-18f5-4a14-aa7f-73573f82c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416ddd19-d678-418d-94f2-ec400b7dd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416ddd19-d678-418d-94f2-ec400b7dd687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1853903791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e685268-7fd1-418e-b744-271bf92fe635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816f4ffecd9147779afe044aaeb3043d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:01Z,use_quota=True,user_id='0cd4ea6dfc214835a4ba3333c382a5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f5805-9ffc-49d7-ad02-e66d5fba341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f5805-9ffc-49d7-ad02-e66d5fba341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca6a355-7018-4f56-8c11-33cf4e3627b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca6a355-7018-4f56-8c11-33cf4e3627b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e685268-7fd1-418e-b744-271bf92fe635', 'volume_name': 'volume-3e685268-7fd1-418e-b744-271bf92fe635', 'volume_size': 2}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bd6160-97ba-4397-8a14-8ae9ce3b36b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bd6160-97ba-4397-8a14-8ae9ce3b36b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4c7ce7-ba7c-49e2-80ac-f56f4f9e26b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:01 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Volume 3e685268-7fd1-418e-b744-271bf92fe635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e685268-7fd1-418e-b744-271bf92fe635', 'volume_size': 2} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1853903791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e685268-7fd1-418e-b744-271bf92fe635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816f4ffecd9147779afe044aaeb3043d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:01Z,use_quota=True,user_id='0cd4ea6dfc214835a4ba3333c382a5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Creating volume 3e685268-7fd1-418e-b744-271bf92fe635 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:01 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 2147483648 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:01 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 2147483648 Nov 02 10:09:01 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:02 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 2147483648" returned: 0 in 0.626s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:02 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 Nov 02 10:09:02 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:02 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635" returned: 0 in 0.263s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4c7ce7-ba7c-49e2-80ac-f56f4f9e26b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e685268-7fd1-418e-b744-271bf92fe635', 'volume_size': 2}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3167b540-fee7-4cbf-bcdb-36a00c9e47e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:02 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Volume volume-3e685268-7fd1-418e-b744-271bf92fe635 (3e685268-7fd1-418e-b744-271bf92fe635): created successfully Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3167b540-fee7-4cbf-bcdb-36a00c9e47e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Flow 'volume_create_manager' (c91a89c6-18f5-4a14-aa7f-73573f82c148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:02 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-bdcc1753-6182-451c-87f0-6b685fd69fdd tempest-VolumesCloneNegativeTest-1535871934 None] Created volume successfully. Nov 02 10:09:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Acquiring lock "cinder-3e685268-7fd1-418e-b744-271bf92fe635-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Lock "cinder-3e685268-7fd1-418e-b744-271bf92fe635-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-dcfb8f71-12b8-4919-a963-4f380b4f180b tempest-GroupSnapshotsTest-791992205 None] Group tempest-GroupSnapshotsTest-Group-1756189132: creating Nov 02 10:09:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-dcfb8f71-12b8-4919-a963-4f380b4f180b tempest-GroupSnapshotsTest-791992205 None] Group tempest-GroupSnapshotsTest-Group-1756189132: created successfully Nov 02 10:09:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Acquiring lock "cinder-quobyte-3e685268-7fd1-418e-b744-271bf92fe635" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-dcfb8f71-12b8-4919-a963-4f380b4f180b tempest-GroupSnapshotsTest-791992205 None] Create group completed successfully. Nov 02 10:09:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Lock "cinder-quobyte-3e685268-7fd1-418e-b744-271bf92fe635" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:04 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed78d81-6fd1-4cc4-a577-ac4191544efe]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:04 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 Nov 02 10:09:04 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:04 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635" returned: 0 in 0.559s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:04 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635 Nov 02 10:09:04 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:04 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3e685268-7fd1-418e-b744-271bf92fe635" returned: 0 in 0.302s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Lock "cinder-quobyte-3e685268-7fd1-418e-b744-271bf92fe635" released by "delete_volume" :: held 0.937s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Created reservations ['9b556eca-f64a-4e10-930b-6c91506b479d', '1c957944-448f-4b8b-91d5-f7a497cec231', '6d9be0eb-913f-433b-856b-859dae8f778e', 'b0a73482-2d2f-4de6-af69-77fa01befa38'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:05 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:05 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:05 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.308s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Deleted volume successfully. Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-734619fb-4af8-4bb9-a7af-fc7b6840692c tempest-VolumesCloneNegativeTest-1535871934 None] Lock "cinder-3e685268-7fd1-418e-b744-271bf92fe635-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (7f1f2985-0018-4ed1-b2a0-f1802644cb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a5df31-5cc7-4ca2-aaef-fd9e9d5ec43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a5df31-5cc7-4ca2-aaef-fd9e9d5ec43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743930484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8813f4d-2e8c-42ff-bdef-e1f8e7d65b9e,host='devstack@QuobyteHD#QuobyteHD',id=e3ae34e3-5049-45ba-a0a4-4aa467821750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:06Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25c0a0ad-06e2-43c9-9625-7677ad7b4ff2),volume_type_id=25c0a0ad-06e2-43c9-9625-7677ad7b4ff2)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5271c78-8546-4e1a-84ce-f0e83301b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5271c78-8546-4e1a-84ce-f0e83301b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c3994-ec41-4b66-81a6-839b945c4f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c3994-ec41-4b66-81a6-839b945c4f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ae34e3-5049-45ba-a0a4-4aa467821750', 'volume_name': 'volume-e3ae34e3-5049-45ba-a0a4-4aa467821750', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ebb19c-ba18-4f9a-b285-814985fac7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ebb19c-ba18-4f9a-b285-814985fac7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666a9357-24ca-4677-a956-fa1c09d52901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:05 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Volume e3ae34e3-5049-45ba-a0a4-4aa467821750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ae34e3-5049-45ba-a0a4-4aa467821750', 'volume_size': 1} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8813f4d-2e8c-42ff-bdef-e1f8e7d65b9e,created_at=2026-11-02T09:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743930484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8813f4d-2e8c-42ff-bdef-e1f8e7d65b9e,host='devstack@QuobyteHD#QuobyteHD',id=e3ae34e3-5049-45ba-a0a4-4aa467821750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:06Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25c0a0ad-06e2-43c9-9625-7677ad7b4ff2),volume_type_id=25c0a0ad-06e2-43c9-9625-7677ad7b4ff2)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Creating volume e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:05 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:05 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 1073741824 Nov 02 10:09:05 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:06 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 1073741824" returned: 0 in 0.610s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:06 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 Nov 02 10:09:06 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:06 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750" returned: 0 in 0.392s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666a9357-24ca-4677-a956-fa1c09d52901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ae34e3-5049-45ba-a0a4-4aa467821750', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e49c98-fbc2-441b-912b-411e85bdb9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:06 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Volume volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 (e3ae34e3-5049-45ba-a0a4-4aa467821750): created successfully Nov 02 10:09:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e49c98-fbc2-441b-912b-411e85bdb9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (7f1f2985-0018-4ed1-b2a0-f1802644cb1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:07 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-dd736908-f552-4e03-8bcb-378f152f7f02 tempest-GroupSnapshotsTest-791992205 None] Created volume successfully. Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-e9e77e5b-a426-4e81-834e-5bde8e844d15 req-de019ac3-4187-4597-a467-89c23586c458 tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-e9e77e5b-a426-4e81-834e-5bde8e844d15 req-de019ac3-4187-4597-a467-89c23586c458 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-e9e77e5b-a426-4e81-834e-5bde8e844d15 req-de019ac3-4187-4597-a467-89c23586c458 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-e9e77e5b-a426-4e81-834e-5bde8e844d15 req-de019ac3-4187-4597-a467-89c23586c458 tempest-TestServerVolumeAttachmentScenario-4958076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce205f94-aa7b-4fa7-b3bf-f7bda73665a2', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] GroupSnapshot b7ccd53d-3713-4d6c-8c01-3a2fc0192d4c: creating. Nov 02 10:09:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-e9e77e5b-a426-4e81-834e-5bde8e844d15 req-de019ac3-4187-4597-a467-89c23586c458 tempest-TestServerVolumeAttachmentScenario-4958076 None] attachment_update completed successfully. Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Group snapshot b7ccd53d-3713-4d6c-8c01-3a2fc0192d4c: creating. {{(pid=87005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Creating offline snapshot 8802b525-2fd7-478b-a495-fd52ee9bfd0d of volume e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a017988a-4087-47a4-9ef1-222bf6862f2e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:09 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 Nov 02 10:09:09 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:09 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750" returned: 0 in 0.510s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:09 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d 1G Nov 02 10:09:09 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:09 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d 1G" returned: 0 in 0.555s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:10 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d Nov 02 10:09:10 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:10 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d" returned: 0 in 0.359s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:10 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:09:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:10 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d Nov 02 10:09:10 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:10 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d" returned: 0 in 0.287s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:10 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.info Nov 02 10:09:10 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:10 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.info" returned: 0 in 0.282s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:10 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:09:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:10 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.info Nov 02 10:09:10 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:11 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.info" returned: 0 in 0.325s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8217822e-66d5-4878-b209-d1cab41d012d tempest-GroupSnapshotsTest-791992205 None] group_snapshot b7ccd53d-3713-4d6c-8c01-3a2fc0192d4c: created successfully Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Flow 'volume_create_manager' (5707ce23-5cb2-488f-a2a6-9e112162a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c729210-3503-4cb3-a396-48ce2edb0de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c729210-3503-4cb3-a396-48ce2edb0de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1789673585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8fe12c-08f7-4229-bdba-e755ea457b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fbc8e8da18481e82186f7acadf4d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:11Z,use_quota=True,user_id='cc2e99c9399244d48379c5a8996679e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc112ea9-20cf-4646-9e6c-2addf5f92972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc112ea9-20cf-4646-9e6c-2addf5f92972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9c7b48-607f-4021-8ff4-1758681ede6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9c7b48-607f-4021-8ff4-1758681ede6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8fe12c-08f7-4229-bdba-e755ea457b5e', 'volume_name': 'volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a31eb-f24b-42cd-bd70-579845ed60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a31eb-f24b-42cd-bd70-579845ed60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf048d8-6fe6-4bf9-bbeb-19e766ddfb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:11 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Volume 5c8fe12c-08f7-4229-bdba-e755ea457b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e', 'volume_size': 1} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1789673585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8fe12c-08f7-4229-bdba-e755ea457b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fbc8e8da18481e82186f7acadf4d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:11Z,use_quota=True,user_id='cc2e99c9399244d48379c5a8996679e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Creating volume 5c8fe12c-08f7-4229-bdba-e755ea457b5e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:11 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:11 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e 1073741824 Nov 02 10:09:11 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:12 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e 1073741824" returned: 0 in 0.499s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:12 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e Nov 02 10:09:12 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:12 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e" returned: 0 in 0.253s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf048d8-6fe6-4bf9-bbeb-19e766ddfb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b34733-885a-460f-bf54-5a59284a9031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:12 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Volume volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e (5c8fe12c-08f7-4229-bdba-e755ea457b5e): created successfully Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b34733-885a-460f-bf54-5a59284a9031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Flow 'volume_create_manager' (5707ce23-5cb2-488f-a2a6-9e112162a73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e8ac7337-2362-460a-ad76-b772781a8293 tempest-VolumesListTestJSON-1472933644 None] Created volume successfully. Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-07db8479-456a-48e6-b7f8-adb054f9cfe8 req-c46e2a0f-98a4-4eac-aec0-ff1085fcd740 tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-07db8479-456a-48e6-b7f8-adb054f9cfe8 req-c46e2a0f-98a4-4eac-aec0-ff1085fcd740 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-07db8479-456a-48e6-b7f8-adb054f9cfe8 req-c46e2a0f-98a4-4eac-aec0-ff1085fcd740 tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-8802b525-2fd7-478b-a495-fd52ee9bfd0d-301f576c-ae62-4f3c-8c37-691c7954fec5" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-8802b525-2fd7-478b-a495-fd52ee9bfd0d-301f576c-ae62-4f3c-8c37-691c7954fec5" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Creating volume 301f576c-ae62-4f3c-8c37-691c7954fec5 from snapshot 8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-301f576c-ae62-4f3c-8c37-691c7954fec5" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-07db8479-456a-48e6-b7f8-adb054f9cfe8 req-c46e2a0f-98a4-4eac-aec0-ff1085fcd740 tempest-TestServerVolumeAttachmentScenario-4958076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-18bcf399-2670-4c82-8bea-5e6406c64d10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a93a2bb-71b7-4ebd-bfcb-810a8d4bb732', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-301f576c-ae62-4f3c-8c37-691c7954fec5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] snapshot: 8802b525-2fd7-478b-a495-fd52ee9bfd0d, volume: 301f576c-ae62-4f3c-8c37-691c7954fec5, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2620a616-7ab5-4c86-ab4f-f13f12ac8c45]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:13 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-07db8479-456a-48e6-b7f8-adb054f9cfe8 req-c46e2a0f-98a4-4eac-aec0-ff1085fcd740 tempest-TestServerVolumeAttachmentScenario-4958076 None] attachment_update completed successfully. Nov 02 10:09:13 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d Nov 02 10:09:13 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:14 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d" returned: 0 in 0.551s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ae34e3-5049-45ba-a0a4-4aa467821750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c2c18-7996-4ed7-b2bb-68522d1a48ac]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:14 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 Nov 02 10:09:14 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Flow 'volume_create_manager' (477ad301-a9dc-43d7-b98e-fd26594696fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0df8386-9e16-4466-a78d-52ccae426fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0df8386-9e16-4466-a78d-52ccae426fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1170629579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc6746c-a74d-434e-beaf-07233e5e2075,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fbc8e8da18481e82186f7acadf4d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:14Z,use_quota=True,user_id='cc2e99c9399244d48379c5a8996679e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695eb1bb-d663-4fbd-bfff-d033cace9cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695eb1bb-d663-4fbd-bfff-d033cace9cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b8cf26-855c-4399-85c5-589037ccd142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b8cf26-855c-4399-85c5-589037ccd142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc6746c-a74d-434e-beaf-07233e5e2075', 'volume_name': 'volume-ebc6746c-a74d-434e-beaf-07233e5e2075', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acdae6a-62e2-4e4d-b964-4998b4530076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acdae6a-62e2-4e4d-b964-4998b4530076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37786a3-248e-4dec-a202-acfef1446b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Volume ebc6746c-a74d-434e-beaf-07233e5e2075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc6746c-a74d-434e-beaf-07233e5e2075', 'volume_size': 1} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750" returned: 0 in 0.500s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:09:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:14 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 Nov 02 10:09:14 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-c50fe329-9c0b-4245-9814-d8392411be1e req-4b1737e4-c8e7-4bb7-bf70-be062ce4bc10 tempest-TestServerVolumeAttachmentScenario-4958076 None] Terminate volume connection completed successfully. Nov 02 10:09:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-c50fe329-9c0b-4245-9814-d8392411be1e req-4b1737e4-c8e7-4bb7-bf70-be062ce4bc10 tempest-TestServerVolumeAttachmentScenario-4958076 None] Deleting attachment 7a93a2bb-71b7-4ebd-bfcb-810a8d4bb732. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:18 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=65,cinder:UPDATE=74,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-fa06b8c6-13b8-4d46-b2d1-b3bcbb78b96e req-1654c283-b9e8-470a-a656-620940b5781f tempest-TestServerVolumeAttachmentScenario-4958076 None] Terminate volume connection completed successfully. Nov 02 10:09:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-fa06b8c6-13b8-4d46-b2d1-b3bcbb78b96e req-1654c283-b9e8-470a-a656-620940b5781f tempest-TestServerVolumeAttachmentScenario-4958076 None] Deleting attachment ce205f94-aa7b-4fa7-b3bf-f7bda73665a2. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Flow 'volume_create_manager' (e827800a-31e1-48ef-880d-adceb2177a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca18563-dbb1-487d-9375-9f4c2ad405dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca18563-dbb1-487d-9375-9f4c2ad405dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1546598025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1d5db3-e149-4437-8d08-f4164c969456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8edb5632a724aa6804b9170f5224673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:22Z,use_quota=True,user_id='e505b67ced544b70a3190bf1f0af9a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9198a4a8-ebe4-4777-a36e-15e8af83d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9198a4a8-ebe4-4777-a36e-15e8af83d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f439fe-88eb-4810-ab4a-f7785a9c85bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f439fe-88eb-4810-ab4a-f7785a9c85bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1d5db3-e149-4437-8d08-f4164c969456', 'volume_name': 'volume-db1d5db3-e149-4437-8d08-f4164c969456', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a73672c-2a2d-40cb-8d5e-0ccdbe0cbe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a73672c-2a2d-40cb-8d5e-0ccdbe0cbe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3180cfd0-08d4-4a78-8ff0-bb2e736ba562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Volume db1d5db3-e149-4437-8d08-f4164c969456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1d5db3-e149-4437-8d08-f4164c969456', 'volume_size': 1} Nov 02 10:09:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:23 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5" returned: 0 in 8.789s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:09:23 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Converted 1024.00 MB image at 116.50 MB/s Nov 02 10:09:23 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:23 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 Nov 02 10:09:23 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:23 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5" returned: 0 in 0.320s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-301f576c-ae62-4f3c-8c37-691c7954fec5" released by "_copy_volume_from_snapshot" :: held 10.293s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-8802b525-2fd7-478b-a495-fd52ee9bfd0d-301f576c-ae62-4f3c-8c37-691c7954fec5" released by "_create_volume_from_snapshot" :: held 10.370s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.396s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.182s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1170629579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc6746c-a74d-434e-beaf-07233e5e2075,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fbc8e8da18481e82186f7acadf4d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:14Z,use_quota=True,user_id='cc2e99c9399244d48379c5a8996679e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Creating volume ebc6746c-a74d-434e-beaf-07233e5e2075 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:23 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:23 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 1073741824 Nov 02 10:09:23 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c01b2067-50eb-43e6-b1e3-297cbf7b4e1e tempest-GroupSnapshotsTest-791992205 None] Create group from source-snapshot-b7ccd53d-3713-4d6c-8c01-3a2fc0192d4c completed successfully. Nov 02 10:09:24 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 1073741824" returned: 0 in 0.587s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:24 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 Nov 02 10:09:24 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:24 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075" returned: 0 in 0.371s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.107s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1546598025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1d5db3-e149-4437-8d08-f4164c969456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8edb5632a724aa6804b9170f5224673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:22Z,use_quota=True,user_id='e505b67ced544b70a3190bf1f0af9a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Creating volume db1d5db3-e149-4437-8d08-f4164c969456 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:24 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:24 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 1073741824 Nov 02 10:09:24 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37786a3-248e-4dec-a202-acfef1446b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc6746c-a74d-434e-beaf-07233e5e2075', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec87f44b-7521-433d-8072-097288a07470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Volume volume-ebc6746c-a74d-434e-beaf-07233e5e2075 (ebc6746c-a74d-434e-beaf-07233e5e2075): created successfully Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec87f44b-7521-433d-8072-097288a07470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Flow 'volume_create_manager' (477ad301-a9dc-43d7-b98e-fd26594696fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-aba76158-0d50-45b6-9eb9-362f81e1da75 tempest-VolumesListTestJSON-1472933644 None] Created volume successfully. Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-301f576c-ae62-4f3c-8c37-691c7954fec5" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-301f576c-ae62-4f3c-8c37-691c7954fec5" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f9f3c7-cc26-4008-bda9-5509c8bc9a1b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:25 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 Nov 02 10:09:25 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:25 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 1073741824" returned: 0 in 0.527s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:25 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 Nov 02 10:09:25 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:25 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5" returned: 0 in 0.405s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:25 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5 Nov 02 10:09:25 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:25 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3180cfd0-08d4-4a78-8ff0-bb2e736ba562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1d5db3-e149-4437-8d08-f4164c969456', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22a4eab-dd6b-4230-8c24-5679dac3899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Volume volume-db1d5db3-e149-4437-8d08-f4164c969456 (db1d5db3-e149-4437-8d08-f4164c969456): created successfully Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22a4eab-dd6b-4230-8c24-5679dac3899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Flow 'volume_create_manager' (e827800a-31e1-48ef-880d-adceb2177a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f48c76d7-5e3c-47b4-bd12-9ca3e493e812 tempest-AttachVolumeNegativeTest-801015686 None] Created volume successfully. Nov 02 10:09:25 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-301f576c-ae62-4f3c-8c37-691c7954fec5" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-301f576c-ae62-4f3c-8c37-691c7954fec5" released by "delete_volume" :: held 0.713s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['07e770b5-15f8-4335-ba3d-ed87fa363859'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:25 devstack cinder-volume[87005]: WARNING cinder.quota [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-259421305 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-259421305, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:09:25 devstack cinder-volume[87005]: WARNING cinder.quota [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-259421305 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-259421305, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:09:25 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['e612f7eb-2c61-44f7-8114-1c12b3885b89', '7f398e4d-2b48-4326-9944-ddaf3f8c0c13', 'e746005c-8075-4096-b175-f845f098bf9a', 'aa8b190c-3456-499b-8a26-8d125e671aed'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:26 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:26 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:26 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] group_snapshot b7ccd53d-3713-4d6c-8c01-3a2fc0192d4c: deleting Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.338s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6fa83503-74dd-4d01-830b-f2b7c8c2ab57 tempest-GroupSnapshotsTest-791992205 None] Delete group completed successfully. Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] group_snapshot b7ccd53d-3713-4d6c-8c01-3a2fc0192d4c: deleting {{(pid=87005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-e3ae34e3-5049-45ba-a0a4-4aa467821750" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-e3ae34e3-5049-45ba-a0a4-4aa467821750" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-8802b525-2fd7-478b-a495-fd52ee9bfd0d" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-8802b525-2fd7-478b-a495-fd52ee9bfd0d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Deleting offline snapshot 8802b525-2fd7-478b-a495-fd52ee9bfd0d of volume e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] snapshot_file for this snap is: volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dcd8a4-73e2-46f3-98ec-0f22a46889d8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Flow 'volume_create_manager' (322d8afd-e78b-4535-8db4-98a11d0970e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a991f0e9-d8ec-44cb-aaeb-57c21ca09195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a991f0e9-d8ec-44cb-aaeb-57c21ca09195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1098916095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a065bd2-516a-4319-931d-0dc3bfd832f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fbc8e8da18481e82186f7acadf4d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:27Z,use_quota=True,user_id='cc2e99c9399244d48379c5a8996679e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104b882f-4e14-4e54-a858-b73cac8aee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104b882f-4e14-4e54-a858-b73cac8aee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079467c-5708-4654-9937-bcd9a4a694f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079467c-5708-4654-9937-bcd9a4a694f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a065bd2-516a-4319-931d-0dc3bfd832f5', 'volume_name': 'volume-6a065bd2-516a-4319-931d-0dc3bfd832f5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a3a2d9-a507-4e27-801f-a91790c633cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a3a2d9-a507-4e27-801f-a91790c633cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d142e708-ccb6-41d7-801e-dab52ed21a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Volume 6a065bd2-516a-4319-931d-0dc3bfd832f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a065bd2-516a-4319-931d-0dc3bfd832f5', 'volume_size': 1} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1098916095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a065bd2-516a-4319-931d-0dc3bfd832f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fbc8e8da18481e82186f7acadf4d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:27Z,use_quota=True,user_id='cc2e99c9399244d48379c5a8996679e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Creating volume 6a065bd2-516a-4319-931d-0dc3bfd832f5 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:26 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:26 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d Nov 02 10:09:26 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:26 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 1073741824 Nov 02 10:09:26 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "cinder-18bcf399-2670-4c82-8bea-5e6406c64d10-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-18bcf399-2670-4c82-8bea-5e6406c64d10-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "cinder-quobyte-18bcf399-2670-4c82-8bea-5e6406c64d10" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-quobyte-18bcf399-2670-4c82-8bea-5e6406c64d10" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee8758f-35f6-4a72-94d1-b1f2ce828b91]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:27 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d" returned: 0 in 0.663s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ae34e3-5049-45ba-a0a4-4aa467821750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:09:27 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 Nov 02 10:09:27 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc41d59-1f68-4288-b27c-5ed85a2bc641]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:27 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 Nov 02 10:09:27 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:27 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 1073741824" returned: 0 in 0.729s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-4fe7c53a-d941-4389-b303-15993c0929ca req-dd8d31af-9694-4246-a91d-efda604e0429 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:27 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 Nov 02 10:09:27 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:27 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10" returned: 0 in 0.529s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:27 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10 Nov 02 10:09:27 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:27 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5" returned: 0 in 0.277s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-4fe7c53a-d941-4389-b303-15993c0929ca req-dd8d31af-9694-4246-a91d-efda604e0429 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.328s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d142e708-ccb6-41d7-801e-dab52ed21a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a065bd2-516a-4319-931d-0dc3bfd832f5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252169ca-fc3f-41fa-b123-45ea37ed1379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-4fe7c53a-d941-4389-b303-15993c0929ca req-dd8d31af-9694-4246-a91d-efda604e0429 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:28 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Volume volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 (6a065bd2-516a-4319-931d-0dc3bfd832f5): created successfully Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252169ca-fc3f-41fa-b123-45ea37ed1379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Flow 'volume_create_manager' (322d8afd-e78b-4535-8db4-98a11d0970e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cebced83-be3c-48bb-8dce-869d38f30ae2 tempest-VolumesListTestJSON-1472933644 None] Created volume successfully. Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-4fe7c53a-d941-4389-b303-15993c0929ca req-dd8d31af-9694-4246-a91d-efda604e0429 tempest-AttachVolumeNegativeTest-801015686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-db1d5db3-e149-4437-8d08-f4164c969456', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1d38ae4-fad1-49a7-b0f9-fab9c88e7065', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:28 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-18bcf399-2670-4c82-8bea-5e6406c64d10" returned: 0 in 0.297s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:28 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750" returned: 0 in 0.689s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-quobyte-18bcf399-2670-4c82-8bea-5e6406c64d10" released by "delete_volume" :: held 0.936s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:28 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d Nov 02 10:09:28 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-4fe7c53a-d941-4389-b303-15993c0929ca req-dd8d31af-9694-4246-a91d-efda604e0429 tempest-AttachVolumeNegativeTest-801015686 None] attachment_update completed successfully. Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Created reservations ['755902b6-d2bf-482e-bbfc-90ee04dfe2b2', '1622d06a-82ed-4816-8304-fd6750f84ef5', '1966f070-63e7-4f2c-8c43-60a0ff762ac8', '0f5c0af1-4bcb-4615-a363-999a24195c6a'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:28 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:28 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:28 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d" returned: 0 in 0.500s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:28 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.317s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Deleted volume successfully. Nov 02 10:09:28 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d Nov 02 10:09:28 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-31a62acc-be37-4006-9a0a-a7fe58384adc tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-18bcf399-2670-4c82-8bea-5e6406c64d10-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:28 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750.8802b525-2fd7-478b-a495-fd52ee9bfd0d" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-8802b525-2fd7-478b-a495-fd52ee9bfd0d" released by "_delete_snapshot" :: held 2.402s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-e3ae34e3-5049-45ba-a0a4-4aa467821750" released by "delete_snapshot" :: held 2.446s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:29 devstack cinder-volume[87005]: WARNING cinder.quota [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-259421305 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-259421305, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] Created reservations ['95ce928d-e9ea-41f4-9bad-a1fb9d69a41c', '310283d5-1fba-47d0-b382-f4137a4ab5e4', '7241175a-d503-4c87-bfc0-1171d2b28573', 'a533f0b2-d392-4da3-a87f-73e5d6c076bd'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-94dbe05a-7eee-4e61-8fed-60fc5a789bcc tempest-GroupSnapshotsTest-791992205 None] group_snapshot b7ccd53d-3713-4d6c-8c01-3a2fc0192d4c: deleted successfully Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "cinder-e94ea9a1-6342-4238-957b-c2ee036c5fb0-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-e94ea9a1-6342-4238-957b-c2ee036c5fb0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "cinder-quobyte-e94ea9a1-6342-4238-957b-c2ee036c5fb0" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-quobyte-e94ea9a1-6342-4238-957b-c2ee036c5fb0" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd2cef-36ac-48a4-84f6-91e8afb6a348]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:29 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 Nov 02 10:09:29 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:30 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0" returned: 0 in 0.485s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:30 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0 Nov 02 10:09:30 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-e3ae34e3-5049-45ba-a0a4-4aa467821750" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-e3ae34e3-5049-45ba-a0a4-4aa467821750" acquired by "delete_volume" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:30 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e94ea9a1-6342-4238-957b-c2ee036c5fb0" returned: 0 in 0.434s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[95324cc0-cbd9-49b2-acfe-3d221f52fd66]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-quobyte-e94ea9a1-6342-4238-957b-c2ee036c5fb0" released by "delete_volume" :: held 0.996s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Created reservations ['1fa03736-2b71-4d36-8f07-dc5c47cb86e3', '0b4fe6bf-97ed-458e-ad36-1ceb05040450', 'e16e08ad-ec62-4fae-a81e-248ed87b5c03', '4b5714b6-bbcc-47ba-bbf7-a15af1baeeba'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:30 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 Nov 02 10:09:30 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:30 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:30 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-1886b8a2-00e6-48ed-b8cd-8ed57a2f0aeb req-6011b941-3c2a-4dd3-b1c7-295c2d37c8c9 tempest-AttachVolumeNegativeTest-801015686 None] Terminate volume connection completed successfully. Nov 02 10:09:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-1886b8a2-00e6-48ed-b8cd-8ed57a2f0aeb req-6011b941-3c2a-4dd3-b1c7-295c2d37c8c9 tempest-AttachVolumeNegativeTest-801015686 None] Deleting attachment c1d38ae4-fad1-49a7-b0f9-fab9c88e7065. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:31 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750" returned: 0 in 0.563s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:31 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:31 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750 Nov 02 10:09:31 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.367s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Deleted volume successfully. Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44e3693c-3e8d-40f9-a24d-00e78254d6ed tempest-TestServerVolumeAttachmentScenario-4958076 None] Lock "cinder-e94ea9a1-6342-4238-957b-c2ee036c5fb0-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:31 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3ae34e3-5049-45ba-a0a4-4aa467821750" returned: 0 in 0.307s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-e3ae34e3-5049-45ba-a0a4-4aa467821750" released by "delete_volume" :: held 0.981s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Created reservations ['8ef0d620-b0e9-41cc-8de0-78fe40dc29c3'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:31 devstack cinder-volume[87005]: WARNING cinder.db.api [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-259421305'] Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Created reservations ['5765cc87-de6a-4b3b-9ee3-a9dd27f8abe5', '41a66846-df26-4bf6-974f-4bd6566cc653', '39e7d604-3b1f-44fb-a824-101e970578db', '04b9d05e-b06c-45a2-8e50-b68c46ef6028'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:31 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:31 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:32 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.380s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:32 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-56f37a3e-98f4-417d-8250-62d768d1f62f tempest-GroupSnapshotsTest-791992205 None] Delete group completed successfully. Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "cinder-6a065bd2-516a-4319-931d-0dc3bfd832f5-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-6a065bd2-516a-4319-931d-0dc3bfd832f5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "cinder-quobyte-6a065bd2-516a-4319-931d-0dc3bfd832f5" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-quobyte-6a065bd2-516a-4319-931d-0dc3bfd832f5" acquired by "delete_volume" :: waited 0.039s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc2b433-ded6-400f-b1e4-e5051988affc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:32 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 Nov 02 10:09:32 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:33 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5" returned: 0 in 0.509s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:33 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5 Nov 02 10:09:33 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:33 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-6a065bd2-516a-4319-931d-0dc3bfd832f5" returned: 0 in 0.492s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-quobyte-6a065bd2-516a-4319-931d-0dc3bfd832f5" released by "delete_volume" :: held 1.084s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6d6b03db-cd4a-401b-8dde-9aa7138bc8af tempest-GroupSnapshotsTest-791992205 None] Group tempest-GroupSnapshotsTest-Group-170814686: creating Nov 02 10:09:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6d6b03db-cd4a-401b-8dde-9aa7138bc8af tempest-GroupSnapshotsTest-791992205 None] Group tempest-GroupSnapshotsTest-Group-170814686: created successfully Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Created reservations ['fbeec5d0-0c65-4d5a-8ce1-d4e5b705af7c', '628ebf15-0b10-4057-b26c-ecbe1d582a45', '76e4e558-a6a1-4658-b2d7-7cdaaf98250a', '81dd0d53-b4a6-4994-a3d0-5c1f9cc085ec'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6d6b03db-cd4a-401b-8dde-9aa7138bc8af tempest-GroupSnapshotsTest-791992205 None] Create group completed successfully. Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:33 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:33 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:34 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.414s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Deleted volume successfully. Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fdd71e18-e450-4abe-83e6-452a23677e7a tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-6a065bd2-516a-4319-931d-0dc3bfd832f5-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "cinder-ebc6746c-a74d-434e-beaf-07233e5e2075-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-ebc6746c-a74d-434e-beaf-07233e5e2075-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "cinder-quobyte-ebc6746c-a74d-434e-beaf-07233e5e2075" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-quobyte-ebc6746c-a74d-434e-beaf-07233e5e2075" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5824e79e-e4d2-4649-a163-6de94987b1ce]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:35 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 Nov 02 10:09:35 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (5d8cbcaf-056c-488e-8b1f-f349689ae487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c308b71e-cc53-4456-88d3-1e4061af2af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c308b71e-cc53-4456-88d3-1e4061af2af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286604550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=601c96fd-2fb5-4c83-a7f6-8677023e1d90,host='devstack@QuobyteHD#QuobyteHD',id=bd46e060-c917-4322-ba6c-d7b7a344294c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:35Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8083260-40cd-44d6-988e-7a6c262cf3b1),volume_type_id=e8083260-40cd-44d6-988e-7a6c262cf3b1)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e640372a-8d72-49be-b139-564a1fe0f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e640372a-8d72-49be-b139-564a1fe0f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bef678d-bf05-4efc-b60b-569799fbf4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bef678d-bf05-4efc-b60b-569799fbf4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd46e060-c917-4322-ba6c-d7b7a344294c', 'volume_name': 'volume-bd46e060-c917-4322-ba6c-d7b7a344294c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbe57b0-e928-4917-8530-5fbd5c3bfc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbe57b0-e928-4917-8530-5fbd5c3bfc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0196633-774f-4216-876f-2fbe2346225f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:35 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Volume bd46e060-c917-4322-ba6c-d7b7a344294c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd46e060-c917-4322-ba6c-d7b7a344294c', 'volume_size': 1} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=601c96fd-2fb5-4c83-a7f6-8677023e1d90,created_at=2026-11-02T09:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286604550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=601c96fd-2fb5-4c83-a7f6-8677023e1d90,host='devstack@QuobyteHD#QuobyteHD',id=bd46e060-c917-4322-ba6c-d7b7a344294c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:35Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8083260-40cd-44d6-988e-7a6c262cf3b1),volume_type_id=e8083260-40cd-44d6-988e-7a6c262cf3b1)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Creating volume bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:35 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:35 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075" returned: 0 in 0.634s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:35 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c 1073741824 Nov 02 10:09:35 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:35 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075 Nov 02 10:09:35 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:35 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebc6746c-a74d-434e-beaf-07233e5e2075" returned: 0 in 0.303s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-quobyte-ebc6746c-a74d-434e-beaf-07233e5e2075" released by "delete_volume" :: held 1.017s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Created reservations ['add5d011-ec3c-4de2-999d-eb2a943f7ec5', 'c0a38ee0-b50d-4cc3-9ec0-8481d62eae82', '74ff2ac8-4cd9-4c3a-8aa4-fdcf2c70a827', '3d2d720d-54d6-4d26-888a-25f5275ad6a2'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:36 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:36 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:36 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c 1073741824" returned: 0 in 0.678s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:36 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c Nov 02 10:09:36 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:36 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.326s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Deleted volume successfully. Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9ef0ff53-4de3-4b0a-aafe-45956e01de8f tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-ebc6746c-a74d-434e-beaf-07233e5e2075-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:36 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c" returned: 0 in 0.307s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0196633-774f-4216-876f-2fbe2346225f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd46e060-c917-4322-ba6c-d7b7a344294c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ff0fa4-8766-4ddb-bb88-b28d0d2b942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Volume volume-bd46e060-c917-4322-ba6c-d7b7a344294c (bd46e060-c917-4322-ba6c-d7b7a344294c): created successfully Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ff0fa4-8766-4ddb-bb88-b28d0d2b942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (5d8cbcaf-056c-488e-8b1f-f349689ae487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4746eb7b-713c-46dd-b353-caa252ba5538 tempest-GroupSnapshotsTest-791992205 None] Created volume successfully. Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "cinder-5c8fe12c-08f7-4229-bdba-e755ea457b5e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-5c8fe12c-08f7-4229-bdba-e755ea457b5e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "cinder-quobyte-5c8fe12c-08f7-4229-bdba-e755ea457b5e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-quobyte-5c8fe12c-08f7-4229-bdba-e755ea457b5e" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea79774-6b3b-454b-9ad3-80fc5e1cfcdb]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:37 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e Nov 02 10:09:37 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:37 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e" returned: 0 in 0.545s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:37 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e Nov 02 10:09:37 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:38 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5c8fe12c-08f7-4229-bdba-e755ea457b5e" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-quobyte-5c8fe12c-08f7-4229-bdba-e755ea457b5e" released by "delete_volume" :: held 0.997s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Created reservations ['d5113312-b02e-45d6-9069-5fea3a2454b4', '8913a868-b769-49c6-b8e1-2cca693231ca', '52de7648-934e-46d8-b30a-a3ea82d25ddb', 'a8754994-ad8d-41f3-8ce9-00d9116d9049'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:38 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:38 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (db2b01d9-c1ff-4ddb-b36f-ea0fe61d9fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6cde9a-9597-4405-b977-11f14e6c7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6cde9a-9597-4405-b977-11f14e6c7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-136392711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=601c96fd-2fb5-4c83-a7f6-8677023e1d90,host='devstack@QuobyteHD#QuobyteHD',id=12d5e19e-5a30-443e-ab1f-dac74fbfa637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:39Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8083260-40cd-44d6-988e-7a6c262cf3b1),volume_type_id=e8083260-40cd-44d6-988e-7a6c262cf3b1)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3375c-4fe6-4257-89d6-afab852be412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3375c-4fe6-4257-89d6-afab852be412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e625ad2e-9e52-459f-b4cb-7381c0e6b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e625ad2e-9e52-459f-b4cb-7381c0e6b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d5e19e-5a30-443e-ab1f-dac74fbfa637', 'volume_name': 'volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea680405-b9e0-4811-81ac-ad7fabe3f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea680405-b9e0-4811-81ac-ad7fabe3f07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af8ded8-5f49-4267-addc-9ff0d68c41d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Volume 12d5e19e-5a30-443e-ab1f-dac74fbfa637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637', 'volume_size': 1} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=601c96fd-2fb5-4c83-a7f6-8677023e1d90,created_at=2026-11-02T09:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-136392711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=601c96fd-2fb5-4c83-a7f6-8677023e1d90,host='devstack@QuobyteHD#QuobyteHD',id=12d5e19e-5a30-443e-ab1f-dac74fbfa637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:39Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8083260-40cd-44d6-988e-7a6c262cf3b1),volume_type_id=e8083260-40cd-44d6-988e-7a6c262cf3b1)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Creating volume 12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:38 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:09:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:39 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:39 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 1073741824 Nov 02 10:09:39 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.415s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Deleted volume successfully. Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94ca8c8-bd13-4651-b53e-b506a034d768 tempest-VolumesListTestJSON-1472933644 None] Lock "cinder-5c8fe12c-08f7-4229-bdba-e755ea457b5e-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:39 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 1073741824" returned: 0 in 0.609s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:39 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 Nov 02 10:09:39 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:39 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637" returned: 0 in 0.353s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af8ded8-5f49-4267-addc-9ff0d68c41d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33094a11-d899-49b8-879e-60450c303d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:40 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Volume volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 (12d5e19e-5a30-443e-ab1f-dac74fbfa637): created successfully Nov 02 10:09:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33094a11-d899-49b8-879e-60450c303d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (db2b01d9-c1ff-4ddb-b36f-ea0fe61d9fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:40 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d41d3d51-94c2-45e7-ba3e-9bebb5d385ad tempest-GroupSnapshotsTest-791992205 None] Created volume successfully. Nov 02 10:09:41 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=148,cinder:SELECT=132,cinder:DELETE=10,cinder:INSERT=38 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cb88271a-0fb1-4aee-ba1e-d9f925364032 tempest-GroupSnapshotsTest-791992205 None] Update group completed successfully. Nov 02 10:09:42 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ec501831-173f-48dc-973b-12c7a7bbf378 tempest-GroupSnapshotsTest-791992205 None] Update group completed successfully. Nov 02 10:09:43 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8d10c666-271f-4339-baa7-762232b3c24c tempest-GroupSnapshotsTest-791992205 None] Update group completed successfully. Nov 02 10:09:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d86c42fb-7017-4675-9893-4001340b5af1 tempest-GroupSnapshotsTest-791992205 None] Update group completed successfully. Nov 02 10:09:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] GroupSnapshot 53bf39a7-2440-479f-b744-a9738c4bf2b4: creating. Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Group snapshot 53bf39a7-2440-479f-b744-a9738c4bf2b4: creating. {{(pid=87005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Creating offline snapshot 13690fd1-e53b-4687-a527-44dc346765f7 of volume 12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda9142e-ad92-435b-bdcf-1e0f19f41d13]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:47 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 Nov 02 10:09:47 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:47 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637" returned: 0 in 0.489s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:47 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 1G Nov 02 10:09:47 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:48 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 1G" returned: 0 in 0.556s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:48 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 Nov 02 10:09:48 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:48 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7" returned: 0 in 0.486s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:48 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:48 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 Nov 02 10:09:48 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:48 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:09:48 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:48 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7" returned: 0 in 0.319s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:49 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.info Nov 02 10:09:49 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:49 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.391s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:09:49 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.info" returned: 0 in 0.349s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:49 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:49 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.info Nov 02 10:09:49 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:49 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.info" returned: 0 in 0.313s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Creating offline snapshot 3c217625-9ae6-4b8f-8b20-3ea43349dac1 of volume bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627e6dc-35e8-443f-aadc-ec81c2b47be9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:49 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c Nov 02 10:09:49 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:50 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c" returned: 0 in 0.766s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:50 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 1G Nov 02 10:09:50 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:51 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 1G" returned: 0 in 1.224s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd46e060-c917-4322-ba6c-d7b7a344294c -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:51 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd46e060-c917-4322-ba6c-d7b7a344294c -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 Nov 02 10:09:51 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:52 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd46e060-c917-4322-ba6c-d7b7a344294c -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1" returned: 0 in 0.587s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:52 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:09:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:52 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 Nov 02 10:09:52 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:52 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1" returned: 0 in 0.601s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:53 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.info Nov 02 10:09:53 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:53 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.info" returned: 0 in 0.515s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:53 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:09:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:53 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.info Nov 02 10:09:53 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:53 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.info" returned: 0 in 0.478s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.328s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:54 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-199d8700-b942-4529-8c74-74fb9ed9862b tempest-GroupSnapshotsTest-791992205 None] group_snapshot 53bf39a7-2440-479f-b744-a9738c4bf2b4: created successfully Nov 02 10:09:54 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] group_snapshot 53bf39a7-2440-479f-b744-a9738c4bf2b4: deleting Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] group_snapshot 53bf39a7-2440-479f-b744-a9738c4bf2b4: deleting {{(pid=87005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-12d5e19e-5a30-443e-ab1f-dac74fbfa637" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-12d5e19e-5a30-443e-ab1f-dac74fbfa637" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-13690fd1-e53b-4687-a527-44dc346765f7" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-13690fd1-e53b-4687-a527-44dc346765f7" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Deleting offline snapshot 13690fd1-e53b-4687-a527-44dc346765f7 of volume 12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] snapshot_file for this snap is: volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bc52ba-e37e-4e7d-8e77-27c1d2100257]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:55 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 Nov 02 10:09:55 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:55 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7" returned: 0 in 0.579s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd2c867-88f3-4a17-9a99-3e6307332d7d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:56 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 Nov 02 10:09:56 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:56 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637" returned: 0 in 0.571s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:56 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 Nov 02 10:09:56 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:56 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7" returned: 0 in 0.454s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:56 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7 Nov 02 10:09:56 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:57 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637.13690fd1-e53b-4687-a527-44dc346765f7" returned: 0 in 0.477s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-13690fd1-e53b-4687-a527-44dc346765f7" released by "_delete_snapshot" :: held 2.293s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-12d5e19e-5a30-443e-ab1f-dac74fbfa637" released by "delete_snapshot" :: held 2.348s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-bd46e060-c917-4322-ba6c-d7b7a344294c" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-bd46e060-c917-4322-ba6c-d7b7a344294c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-3c217625-9ae6-4b8f-8b20-3ea43349dac1" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-3c217625-9ae6-4b8f-8b20-3ea43349dac1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Deleting offline snapshot 3c217625-9ae6-4b8f-8b20-3ea43349dac1 of volume bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] snapshot_file for this snap is: volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae17205-4f31-47cf-a21d-65c4eeae61c6]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:57 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 Nov 02 10:09:57 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:58 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1" returned: 0 in 0.461s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd46e060-c917-4322-ba6c-d7b7a344294c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:09:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910885f-a4c5-4846-8265-9482cdde9425]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:58 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c Nov 02 10:09:58 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:58 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c" returned: 0 in 0.641s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:58 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 Nov 02 10:09:58 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:59 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1" returned: 0 in 0.511s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:59 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1 Nov 02 10:09:59 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:59 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c.3c217625-9ae6-4b8f-8b20-3ea43349dac1" returned: 0 in 0.389s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-3c217625-9ae6-4b8f-8b20-3ea43349dac1" released by "_delete_snapshot" :: held 2.246s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-bd46e060-c917-4322-ba6c-d7b7a344294c" released by "delete_snapshot" :: held 2.283s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:00 devstack cinder-volume[87005]: WARNING cinder.quota [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2109140023 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2109140023, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:10:00 devstack cinder-volume[87005]: WARNING cinder.quota [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2109140023 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2109140023, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:10:00 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['c75f3901-428c-4279-9d62-6a98c35d457b', 'b557261d-30ba-4d3d-a00c-1b5e51ce43ef', '7913356c-c0dd-48ff-938f-10d38735d8f4', 'bc063999-411e-4e2a-9303-9e0f05cbe943'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:00 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['ff48a852-848a-41b2-b4b9-9d41d85218a8', '3a9deb50-e322-4014-a1af-4576f7a04ed0', '7ac0e716-72f2-4d3d-9730-876b6130bc6c', '539377a8-16d6-4e9a-8993-58c2f0c4d1d9'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cd6f8994-fb42-4b9d-8f85-a3914b312f22 tempest-GroupSnapshotsTest-791992205 None] group_snapshot 53bf39a7-2440-479f-b744-a9738c4bf2b4: deleted successfully Nov 02 10:10:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-12d5e19e-5a30-443e-ab1f-dac74fbfa637" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-12d5e19e-5a30-443e-ab1f-dac74fbfa637" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:01 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd31e20b-e334-4150-b833-1c07c2b949a6]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:02 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 Nov 02 10:10:02 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:02 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637" returned: 0 in 0.520s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:02 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637 Nov 02 10:10:02 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:02 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12d5e19e-5a30-443e-ab1f-dac74fbfa637" returned: 0 in 0.488s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-12d5e19e-5a30-443e-ab1f-dac74fbfa637" released by "delete_volume" :: held 1.102s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-bd46e060-c917-4322-ba6c-d7b7a344294c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-bd46e060-c917-4322-ba6c-d7b7a344294c" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b641ea-0b4a-44a6-9e10-b8612b4e8719]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:03 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c Nov 02 10:10:03 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:03 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c" returned: 0 in 0.811s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:03 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c Nov 02 10:10:03 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:04 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bd46e060-c917-4322-ba6c-d7b7a344294c" returned: 0 in 0.392s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-bd46e060-c917-4322-ba6c-d7b7a344294c" released by "delete_volume" :: held 1.291s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['6535c95f-9a8e-4920-baeb-0e13fbfbb827'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:04 devstack cinder-volume[87005]: WARNING cinder.quota [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2109140023 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2109140023, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:10:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['69aab79e-4400-4fff-a32e-3144a832a1b5', '6f2004a0-c708-4600-9c64-ae0bc25561d3', '7b4b1d76-6e48-4261-8d4a-c8cb3192017c', '00c0d0b1-a215-4214-90df-02949b656523'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['67628c5f-df60-4fa9-9339-6aa66770e690', '366f6af4-530e-423f-b111-a8f1b329d96e', '574f88af-a473-4e5a-b02d-484bc3ad33c4', '57524ee1-c21f-4705-b601-ff0364fb2f8f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:05 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:10:05 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:05 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.514s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:05 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3551c75a-57ea-46c7-a9e1-38995518e826 tempest-GroupSnapshotsTest-791992205 None] Delete group completed successfully. Nov 02 10:10:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2a979787-6a88-4534-bd81-bb3b338762f3 tempest-GroupSnapshotsTest-791992205 None] Group tempest-GroupSnapshotsTest-Group-613781373: creating Nov 02 10:10:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2a979787-6a88-4534-bd81-bb3b338762f3 tempest-GroupSnapshotsTest-791992205 None] Group tempest-GroupSnapshotsTest-Group-613781373: created successfully Nov 02 10:10:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2a979787-6a88-4534-bd81-bb3b338762f3 tempest-GroupSnapshotsTest-791992205 None] Create group completed successfully. Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (c09fdee7-5702-4462-8d6b-3317738885ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40191790-db04-458a-a09a-b20fb7ec7877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40191790-db04-458a-a09a-b20fb7ec7877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-340360194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d02ab44e-0874-4ea7-9c40-c6f25f65c185,host='devstack@QuobyteHD#QuobyteHD',id=d855131a-6d5b-4155-bb50-4840dd588c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:08Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36de44fa-418e-48c4-8d1d-4f883bb03623),volume_type_id=36de44fa-418e-48c4-8d1d-4f883bb03623)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b46991e-936f-491f-a0ef-7397f370b2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b46991e-936f-491f-a0ef-7397f370b2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259c7631-a708-42b0-8568-a684bef9674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259c7631-a708-42b0-8568-a684bef9674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd855131a-6d5b-4155-bb50-4840dd588c6a', 'volume_name': 'volume-d855131a-6d5b-4155-bb50-4840dd588c6a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cca3c1-e599-4ff0-b10b-042ca4f40584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cca3c1-e599-4ff0-b10b-042ca4f40584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4f6d2e-2022-4006-90d9-4332a198f04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:08 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Volume d855131a-6d5b-4155-bb50-4840dd588c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d855131a-6d5b-4155-bb50-4840dd588c6a', 'volume_size': 1} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d02ab44e-0874-4ea7-9c40-c6f25f65c185,created_at=2026-11-02T09:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-340360194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d02ab44e-0874-4ea7-9c40-c6f25f65c185,host='devstack@QuobyteHD#QuobyteHD',id=d855131a-6d5b-4155-bb50-4840dd588c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6188034c454c9bba0345a6d87b3d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:08Z,use_quota=True,user_id='417e3a47c636453183722b8e80f4af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36de44fa-418e-48c4-8d1d-4f883bb03623),volume_type_id=36de44fa-418e-48c4-8d1d-4f883bb03623)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Creating volume d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:08 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:10:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:08 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a 1073741824 Nov 02 10:10:08 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:09 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a 1073741824" returned: 0 in 0.700s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:09 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a Nov 02 10:10:09 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:09 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a" returned: 0 in 0.340s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4f6d2e-2022-4006-90d9-4332a198f04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d855131a-6d5b-4155-bb50-4840dd588c6a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5d863-4408-44d4-8905-0baa6afa6467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Volume volume-d855131a-6d5b-4155-bb50-4840dd588c6a (d855131a-6d5b-4155-bb50-4840dd588c6a): created successfully Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5d863-4408-44d4-8905-0baa6afa6467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Flow 'volume_create_manager' (c09fdee7-5702-4462-8d6b-3317738885ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e0abdc29-0d2b-4960-95df-b8da3631e69c tempest-GroupSnapshotsTest-791992205 None] Created volume successfully. Nov 02 10:10:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] GroupSnapshot adfadcdd-cd79-47bc-b672-a8755867977b: creating. Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Group snapshot adfadcdd-cd79-47bc-b672-a8755867977b: creating. {{(pid=87005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Creating offline snapshot 6f32118b-2c39-406e-b9e1-f028f44c6602 of volume d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c48f86-762f-406a-9ec6-626041c68b48]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:11 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a Nov 02 10:10:11 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:11 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a" returned: 0 in 0.547s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:11 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 1G Nov 02 10:10:11 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:12 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 1G" returned: 0 in 0.804s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d855131a-6d5b-4155-bb50-4840dd588c6a -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:12 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d855131a-6d5b-4155-bb50-4840dd588c6a -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 Nov 02 10:10:12 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:13 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d855131a-6d5b-4155-bb50-4840dd588c6a -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602" returned: 0 in 0.485s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:13 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:10:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:13 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 Nov 02 10:10:13 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:13 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602" returned: 0 in 0.439s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:13 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.info Nov 02 10:10:13 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:13 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.info" returned: 0 in 0.359s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:13 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:10:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:13 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.info Nov 02 10:10:13 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:14 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.info" returned: 0 in 0.490s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.263s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2ab3b0c6-0462-46ec-a4ef-dedb1fb0364b tempest-GroupSnapshotsTest-791992205 None] group_snapshot adfadcdd-cd79-47bc-b672-a8755867977b: created successfully Nov 02 10:10:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] group_snapshot adfadcdd-cd79-47bc-b672-a8755867977b: deleting Nov 02 10:10:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] group_snapshot adfadcdd-cd79-47bc-b672-a8755867977b: deleting {{(pid=87005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:10:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-d855131a-6d5b-4155-bb50-4840dd588c6a" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-d855131a-6d5b-4155-bb50-4840dd588c6a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-6f32118b-2c39-406e-b9e1-f028f44c6602" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-6f32118b-2c39-406e-b9e1-f028f44c6602" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Deleting offline snapshot 6f32118b-2c39-406e-b9e1-f028f44c6602 of volume d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] snapshot_file for this snap is: volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db56199-e8f1-4137-b751-db186b126f55]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:16 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 Nov 02 10:10:16 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:16 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602" returned: 0 in 0.629s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d855131a-6d5b-4155-bb50-4840dd588c6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0801182-5693-4115-b74d-68a647665861]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:16 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a Nov 02 10:10:16 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:17 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a" returned: 0 in 0.762s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:17 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 Nov 02 10:10:17 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Flow 'volume_create_manager' (3b5f756c-3825-4881-a6a6-252163f6386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f20aca6-a253-4e2f-b836-8fd74820cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f20aca6-a253-4e2f-b836-8fd74820cceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-133916704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc31b1-5ca3-4a99-a6a3-216c32903063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8edb5632a724aa6804b9170f5224673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:18Z,use_quota=True,user_id='e505b67ced544b70a3190bf1f0af9a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6eb947-1aa2-495b-a82a-e26045a58eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6eb947-1aa2-495b-a82a-e26045a58eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6b5ef7-21d7-41eb-8134-a5b76ed0149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6b5ef7-21d7-41eb-8134-a5b76ed0149e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfc31b1-5ca3-4a99-a6a3-216c32903063', 'volume_name': 'volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc64f84d-accb-4774-84be-505964a08aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc64f84d-accb-4774-84be-505964a08aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d65a9ba-58ad-4cec-97b6-ae7d030d4405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Volume bbfc31b1-5ca3-4a99-a6a3-216c32903063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063', 'volume_size': 1} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-133916704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc31b1-5ca3-4a99-a6a3-216c32903063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8edb5632a724aa6804b9170f5224673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:18Z,use_quota=True,user_id='e505b67ced544b70a3190bf1f0af9a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Creating volume bbfc31b1-5ca3-4a99-a6a3-216c32903063 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:17 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:10:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:18 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 1073741824 Nov 02 10:10:18 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:18 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602" returned: 0 in 0.575s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:18 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602 Nov 02 10:10:18 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:18 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a.6f32118b-2c39-406e-b9e1-f028f44c6602" returned: 0 in 0.377s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-6f32118b-2c39-406e-b9e1-f028f44c6602" released by "_delete_snapshot" :: held 2.619s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-d855131a-6d5b-4155-bb50-4840dd588c6a" released by "delete_snapshot" :: held 2.681s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:18 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 1073741824" returned: 0 in 0.747s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:18 devstack cinder-volume[87005]: WARNING cinder.quota [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1830882065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1830882065, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:10:18 devstack cinder-volume[87005]: WARNING cinder.quota [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1830882065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1830882065, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:10:18 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 Nov 02 10:10:18 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:18 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] Created reservations ['ff9acef0-77c3-44b6-8c35-8dc96edbea7e', '906f71cb-e8c4-4ad3-851e-0007a39fa7a5', '317196be-4439-4a26-a004-dc353ed82235', '99351af4-7b63-422b-9f9d-a3754c710089'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-112d649d-9e2b-47a0-a0ab-f5ee5be72329 tempest-GroupSnapshotsTest-791992205 None] group_snapshot adfadcdd-cd79-47bc-b672-a8755867977b: deleted successfully Nov 02 10:10:19 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063" returned: 0 in 0.378s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d65a9ba-58ad-4cec-97b6-ae7d030d4405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02c7a5a-7414-466f-94a9-f65c37424270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=134,cinder:UPDATE=149,cinder:INSERT=25,cinder:DELETE=6 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:10:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Volume volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 (bbfc31b1-5ca3-4a99-a6a3-216c32903063): created successfully Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02c7a5a-7414-466f-94a9-f65c37424270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Flow 'volume_create_manager' (3b5f756c-3825-4881-a6a6-252163f6386a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4525234b-0bfb-4837-80f5-47082a734321 tempest-AttachVolumeNegativeTest-801015686 None] Created volume successfully. Nov 02 10:10:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "cinder-quobyte-d855131a-6d5b-4155-bb50-4840dd588c6a" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-d855131a-6d5b-4155-bb50-4840dd588c6a" acquired by "delete_volume" :: waited 0.059s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:20 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70db6cd-691a-4e7c-b8c8-aef4af3238a4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:20 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a Nov 02 10:10:20 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:20 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a" returned: 0 in 0.491s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:20 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a Nov 02 10:10:20 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:21 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d855131a-6d5b-4155-bb50-4840dd588c6a" returned: 0 in 0.431s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Lock "cinder-quobyte-d855131a-6d5b-4155-bb50-4840dd588c6a" released by "delete_volume" :: held 1.065s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Created reservations ['ebd5bd7b-757d-4e00-bb2f-da2f98a96d31'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:21 devstack cinder-volume[87005]: WARNING cinder.quota [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1830882065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1830882065, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-e2879783-1024-44eb-93c0-98ae9f637427 req-69ebc35f-cef0-4221-9ede-ff39d1c25b06 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-e2879783-1024-44eb-93c0-98ae9f637427 req-69ebc35f-cef0-4221-9ede-ff39d1c25b06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Created reservations ['4a585a37-b92e-433d-a6ea-29c9671bad5f', '5b2b6027-027d-4e33-b353-d0b1ba5484a5', '8725262a-c343-43b3-9e95-2feb742a699c', '327a9455-5ded-4df5-b5be-6ff111096029'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-e2879783-1024-44eb-93c0-98ae9f637427 req-69ebc35f-cef0-4221-9ede-ff39d1c25b06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-e2879783-1024-44eb-93c0-98ae9f637427 req-69ebc35f-cef0-4221-9ede-ff39d1c25b06 tempest-AttachVolumeNegativeTest-801015686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e82b460-a90e-4033-9a7d-96faeac11e47', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:10:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-e2879783-1024-44eb-93c0-98ae9f637427 req-69ebc35f-cef0-4221-9ede-ff39d1c25b06 tempest-AttachVolumeNegativeTest-801015686 None] attachment_update completed successfully. Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:21 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:10:21 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:21 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.351s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:21 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8d52edce-ea97-4b99-9dd2-046795bfdbfd tempest-GroupSnapshotsTest-791992205 None] Delete group completed successfully. Nov 02 10:10:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-d3f42c66-d7dd-48ca-91d3-91d5ed72fe56 req-d124d2ab-fa17-4c1b-abc6-cbe967ea3932 tempest-AttachVolumeNegativeTest-801015686 None] Terminate volume connection completed successfully. Nov 02 10:10:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-d3f42c66-d7dd-48ca-91d3-91d5ed72fe56 req-d124d2ab-fa17-4c1b-abc6-cbe967ea3932 tempest-AttachVolumeNegativeTest-801015686 None] Deleting attachment 4e82b460-a90e-4033-9a7d-96faeac11e47. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:10:31 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=59,cinder:SELECT=77,cinder:INSERT=19,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:10:34 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:10:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "cinder-bbfc31b1-5ca3-4a99-a6a3-216c32903063-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-bbfc31b1-5ca3-4a99-a6a3-216c32903063-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "cinder-quobyte-bbfc31b1-5ca3-4a99-a6a3-216c32903063" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-quobyte-bbfc31b1-5ca3-4a99-a6a3-216c32903063" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:36 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2628b13-bfa2-4fc7-980b-d085ccb44839]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:36 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 Nov 02 10:10:36 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:37 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063" returned: 0 in 0.602s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:37 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063 Nov 02 10:10:37 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:37 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bbfc31b1-5ca3-4a99-a6a3-216c32903063" returned: 0 in 0.604s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-quobyte-bbfc31b1-5ca3-4a99-a6a3-216c32903063" released by "delete_volume" :: held 1.293s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Created reservations ['b90b07c5-233f-476c-8946-33109252695e', '300daad0-b557-4cb0-82f3-d12767ecc831', '15dc5cfe-d5fc-49bd-96e6-95dffb35cd63', 'b2e30024-87a5-48c2-82f0-09019cf1ba76'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:38 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:10:38 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:38 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.539s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:38 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Deleted volume successfully. Nov 02 10:10:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e109ccf1-b1a3-4464-a6b0-5fb6a5b6a577 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-bbfc31b1-5ca3-4a99-a6a3-216c32903063-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "cinder-db1d5db3-e149-4437-8d08-f4164c969456-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-de809b51-cf89-4907-ab8f-fe911966cb84 tempest-GroupsV314Test-292908799 None] Group tempest-GroupsV314Test-Group-2100377011: creating Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-db1d5db3-e149-4437-8d08-f4164c969456-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-de809b51-cf89-4907-ab8f-fe911966cb84 tempest-GroupsV314Test-292908799 None] Group tempest-GroupsV314Test-Group-2100377011: created successfully Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "cinder-quobyte-db1d5db3-e149-4437-8d08-f4164c969456" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-de809b51-cf89-4907-ab8f-fe911966cb84 tempest-GroupsV314Test-292908799 None] Create group completed successfully. Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-quobyte-db1d5db3-e149-4437-8d08-f4164c969456" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc914570-599f-42a9-a640-c291a363e28a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:39 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 Nov 02 10:10:39 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:39 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456" returned: 0 in 0.488s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:39 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456 Nov 02 10:10:39 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:40 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-db1d5db3-e149-4437-8d08-f4164c969456" returned: 0 in 0.445s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-quobyte-db1d5db3-e149-4437-8d08-f4164c969456" released by "delete_volume" :: held 1.040s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Flow 'volume_create_manager' (13c4a481-da92-4f02-9979-7ebc1cbcff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a53f39-633a-46d0-9ffb-1fb523dc8ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a53f39-633a-46d0-9ffb-1fb523dc8ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1527299827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c69e076-ae2a-452c-8526-fc932ce5f746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4339d5039714f0ca1b933970860714f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:40Z,use_quota=True,user_id='eba9e39fbc1d4734a33d7ee350f6347b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1174de-c7a7-4108-9ae4-436652711655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1174de-c7a7-4108-9ae4-436652711655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1084541b-28e4-47a1-85f3-50f9f87ccc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1084541b-28e4-47a1-85f3-50f9f87ccc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c69e076-ae2a-452c-8526-fc932ce5f746', 'volume_name': 'volume-4c69e076-ae2a-452c-8526-fc932ce5f746', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a18bcef-2aab-471b-90a1-7e2a704218a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a18bcef-2aab-471b-90a1-7e2a704218a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a3437f-8e90-4e14-ad62-fd384cc6fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:40 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Volume 4c69e076-ae2a-452c-8526-fc932ce5f746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c69e076-ae2a-452c-8526-fc932ce5f746', 'volume_size': 1} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1527299827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c69e076-ae2a-452c-8526-fc932ce5f746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4339d5039714f0ca1b933970860714f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:40Z,use_quota=True,user_id='eba9e39fbc1d4734a33d7ee350f6347b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Creating volume 4c69e076-ae2a-452c-8526-fc932ce5f746 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:40 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:40 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 1073741824 Nov 02 10:10:40 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Created reservations ['4871c22a-0b08-4e18-81eb-35bc41d4dfa0', 'c9878c4c-7435-4e16-840a-90034f712922', '97a54b46-bf56-4025-a072-2fd89f3242be', '60ad2ec0-6698-4b53-ac9e-c56ce807dfe5'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:41 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:10:41 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Flow 'volume_create_manager' (9b6252cd-c96b-493e-ab36-f1dc0f84fc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091d57a6-86a3-4d54-b7fa-d90d914d655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091d57a6-86a3-4d54-b7fa-d90d914d655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936073887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b611d8c8-1233-46b8-b5a6-b25bc36233cf,host='devstack@QuobyteHD#QuobyteHD',id=2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3305ecf5c5841aa928c18537bf7be13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:41Z,use_quota=True,user_id='243bfa93f3d445a094854dd19184e668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7941d2f3-aaf7-49eb-b6a2-765ed31ff2c1),volume_type_id=7941d2f3-aaf7-49eb-b6a2-765ed31ff2c1)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:41 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353f73f6-f21f-4559-8452-f0383bdf446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:41 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353f73f6-f21f-4559-8452-f0383bdf446b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b87a730-973f-4af9-bb8b-e77ed39bf7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b87a730-973f-4af9-bb8b-e77ed39bf7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9', 'volume_name': 'volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d855d0eb-a8ba-42b4-a3ec-563566e42d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d855d0eb-a8ba-42b4-a3ec-563566e42d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808539f0-9efb-49e6-8a88-a76c0de4322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:41 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Volume 2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9', 'volume_size': 1} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.536s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 1073741824" returned: 0 in 0.861s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Deleted volume successfully. Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6bd60ee1-6122-4550-874d-81fb79633432 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-db1d5db3-e149-4437-8d08-f4164c969456-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:41 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 Nov 02 10:10:41 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "cinder-fc2daacf-379e-42ad-bc64-2dbc96c642a9-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:42 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746" returned: 0 in 0.458s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b611d8c8-1233-46b8-b5a6-b25bc36233cf,created_at=2026-11-02T09:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936073887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b611d8c8-1233-46b8-b5a6-b25bc36233cf,host='devstack@QuobyteHD#QuobyteHD',id=2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3305ecf5c5841aa928c18537bf7be13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:41Z,use_quota=True,user_id='243bfa93f3d445a094854dd19184e668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7941d2f3-aaf7-49eb-b6a2-765ed31ff2c1),volume_type_id=7941d2f3-aaf7-49eb-b6a2-765ed31ff2c1)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Creating volume 2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:42 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:42 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 1073741824 Nov 02 10:10:42 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a3437f-8e90-4e14-ad62-fd384cc6fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c69e076-ae2a-452c-8526-fc932ce5f746', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f6e922-08d9-4f5e-b5cd-9eff241b9040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-fc2daacf-379e-42ad-bc64-2dbc96c642a9-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Flow 'volume_create_manager' (263c7a9a-880d-4d4f-8634-71aaf7edb1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa14717-bffe-436b-b7e7-167562b1a565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:42 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Volume volume-4c69e076-ae2a-452c-8526-fc932ce5f746 (4c69e076-ae2a-452c-8526-fc932ce5f746): created successfully Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f6e922-08d9-4f5e-b5cd-9eff241b9040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Flow 'volume_create_manager' (13c4a481-da92-4f02-9979-7ebc1cbcff05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa14717-bffe-436b-b7e7-167562b1a565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1999295017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fb4426-a502-471e-80f5-06dc7947230c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ebaa7527f16481a977bc8dfaa4f6c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:42Z,use_quota=True,user_id='6c78ebbac41c42e5ba7572854e964ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e08528-ef9a-48f0-9628-6af4eded28e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e08528-ef9a-48f0-9628-6af4eded28e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47db411e-26b3-47e0-8d88-6d3817ffa326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:10:42 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-857a3140-61dd-4fbd-a98a-82c6686c1cb8 tempest-TestMinimumBasicScenario-150843868 None] Created volume successfully. Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "cinder-quobyte-fc2daacf-379e-42ad-bc64-2dbc96c642a9" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-quobyte-fc2daacf-379e-42ad-bc64-2dbc96c642a9" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78c48d-c259-40f3-bd24-63a4d6375388]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:42 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 Nov 02 10:10:42 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47db411e-26b3-47e0-8d88-6d3817ffa326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82fb4426-a502-471e-80f5-06dc7947230c', 'volume_name': 'volume-82fb4426-a502-471e-80f5-06dc7947230c', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ddc3df-a2b8-475f-83ab-92cdbd2d64a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ddc3df-a2b8-475f-83ab-92cdbd2d64a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e622c01d-2456-4ab4-88b4-44b420d83e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:42 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Volume 82fb4426-a502-471e-80f5-06dc7947230c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82fb4426-a502-471e-80f5-06dc7947230c', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Trying to clone 82fb4426-a502-471e-80f5-06dc7947230c from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:10:42 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 1073741824" returned: 0 in 0.789s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:42 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9" returned: 0 in 0.585s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:42 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9 Nov 02 10:10:42 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:43 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 Nov 02 10:10:43 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:43 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" returned: 0 in 0.533s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:10:43 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808539f0-9efb-49e6-8a88-a76c0de4322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959584d4-ca2b-4e8f-838d-ac3a97bbbad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:43 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fc2daacf-379e-42ad-bc64-2dbc96c642a9" returned: 0 in 0.664s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:43 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Volume volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 (2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9): created successfully Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959584d4-ca2b-4e8f-838d-ac3a97bbbad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Flow 'volume_create_manager' (9b6252cd-c96b-493e-ab36-f1dc0f84fc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-quobyte-fc2daacf-379e-42ad-bc64-2dbc96c642a9" released by "delete_volume" :: held 1.348s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:43 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-75471af6-0728-4eef-8c5f-0ee1a5e273d5 tempest-GroupsV314Test-292908799 None] Created volume successfully. Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ad4cee-c6b1-4a27-89a7-910c39343052]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Created reservations ['930f61a9-6f74-4dd0-82e9-2ed2c7dfc068', '34a7ba4d-2ea4-43e5-b4e6-c9d0b932926f', 'c0291bbf-9657-4f11-b68c-a653d2759583', 'a9c10705-8b41-4018-97fe-4562513dd881'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:43 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD Nov 02 10:10:43 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:43 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:10:43 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:44 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 is fetched for user 6c78ebbac41c42e5ba7572854e964ae3. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d424b803-b504-4a6a-9f82-534d3e8f150a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-c93c91fa-9084-4748-8cb3-3c943344dad5 req-f0c8154e-2818-4c2f-99a0-bab98f631901 tempest-TestMinimumBasicScenario-150843868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-c93c91fa-9084-4748-8cb3-3c943344dad5 req-f0c8154e-2818-4c2f-99a0-bab98f631901 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-c93c91fa-9084-4748-8cb3-3c943344dad5 req-f0c8154e-2818-4c2f-99a0-bab98f631901 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:44 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.484s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:44 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Deleted volume successfully. Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-c93c91fa-9084-4748-8cb3-3c943344dad5 req-f0c8154e-2818-4c2f-99a0-bab98f631901 tempest-TestMinimumBasicScenario-150843868 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-4c69e076-ae2a-452c-8526-fc932ce5f746', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c13c7c1-35bc-4406-89ba-d1f0c6d36edf', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ac0102aa-62d1-4616-9b42-afdba355ca06 tempest-AttachVolumeNegativeTest-801015686 None] Lock "cinder-fc2daacf-379e-42ad-bc64-2dbc96c642a9-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:44 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD Nov 02 10:10:44 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:44 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-c93c91fa-9084-4748-8cb3-3c943344dad5 req-f0c8154e-2818-4c2f-99a0-bab98f631901 tempest-TestMinimumBasicScenario-150843868 None] attachment_update completed successfully. Nov 02 10:10:44 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1999295017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fb4426-a502-471e-80f5-06dc7947230c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ebaa7527f16481a977bc8dfaa4f6c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:42Z,use_quota=True,user_id='6c78ebbac41c42e5ba7572854e964ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Creating volume 82fb4426-a502-471e-80f5-06dc7947230c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:45 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:10:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:45 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c 1073741824 Nov 02 10:10:45 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:45 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c 1073741824" returned: 0 in 0.789s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:45 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c Nov 02 10:10:45 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:46 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c" returned: 0 in 0.374s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.140s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:46 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Cloning volume 2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 to volume d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Attempting download of 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume 82fb4426-a502-471e-80f5-06dc7947230c. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Creating offline snapshot d380ec2b-0bf3-4bec-ad26-b237b6861d27 of volume 2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6a82e7-8f1d-45dc-a0b3-f72877e0408a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ab2df-37ce-487c-95f2-af4ebc4c000f]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_haxolii5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:46 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 Nov 02 10:10:46 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:46 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_haxolii5 Nov 02 10:10:46 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:46 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" returned: 0 in 0.524s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:46 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 1G Nov 02 10:10:46 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:47 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_haxolii5" returned: 0 in 0.646s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_haxolii5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:47 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_haxolii5 Nov 02 10:10:47 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:47 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 1G" returned: 0 in 0.630s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:47 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 Nov 02 10:10:47 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:47 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_haxolii5" returned: 1 in 0.529s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_haxolii5' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06fb017-f3aa-48ea-b6c9-fbf3cefcc976]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:47 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD Nov 02 10:10:47 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:48 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] 4e759a38-67b9-4ba7-b77d-917ff16305f2 was qcow2, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c Nov 02 10:10:48 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:48 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27" returned: 0 in 0.748s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:48 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 Nov 02 10:10:48 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:48 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27" returned: 0 in 0.480s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:10:48 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:48 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.info Nov 02 10:10:48 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:49 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.560s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:49 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.info" returned: 0 in 0.537s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:49 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:10:49 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.info Nov 02 10:10:49 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:49 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.info" returned: 0 in 0.558s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Acquiring lock "cinder-quobyte-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] snapshot: d380ec2b-0bf3-4bec-ad26-b237b6861d27, volume: d2d23352-0cc6-4a9d-b6d7-96bdacb15af1, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cafa3d0-4dfb-42cf-b1d4-2b33ebe26c30]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:50 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 Nov 02 10:10:50 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:50 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27" returned: 0 in 0.583s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc5d85-b0ac-49ed-8a76-3851cfa99217]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:50 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 Nov 02 10:10:50 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:51 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c" returned: 0 in 3.180s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_lyocgfh5devstack@QuobyteHD, size 112.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:10:51 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Converted 112.00 MB image at 35.20 MB/s Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:51 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c 1G Nov 02 10:10:51 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:51 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" returned: 0 in 0.749s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:51 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 Nov 02 10:10:51 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:51 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c 1G" returned: 0 in 0.450s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Downloaded image 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume 82fb4426-a502-471e-80f5-06dc7947230c successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 for user 6c78ebbac41c42e5ba7572854e964ae3 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Marking volume 82fb4426-a502-471e-80f5-06dc7947230c as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Copying metadata from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 to 82fb4426-a502-471e-80f5-06dc7947230c. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Creating volume glance metadata for volume 82fb4426-a502-471e-80f5-06dc7947230c backed by image 4e759a38-67b9-4ba7-b77d-917ff16305f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e622c01d-2456-4ab4-88b4-44b420d83e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fb4426-a502-471e-80f5-06dc7947230c', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10d6186-4448-4939-9cbc-c9f607dc1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:51 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Volume volume-82fb4426-a502-471e-80f5-06dc7947230c (82fb4426-a502-471e-80f5-06dc7947230c): created successfully Nov 02 10:10:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10d6186-4448-4939-9cbc-c9f607dc1f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Flow 'volume_create_manager' (263c7a9a-880d-4d4f-8634-71aaf7edb1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a9a7db8c-609a-4c93-b542-398d85bf074e tempest-TestShelveInstance-1403493392 None] Created volume successfully. Nov 02 10:11:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-aadf1f95-fd07-4afd-ad17-a9f7583427a0 req-cad231c6-fc5c-40c7-9e74-b48705521557 tempest-TestShelveInstance-1403493392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:01 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" returned: 0 in 10.441s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:01 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9, size 1024.00 MB, duration 10.44 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:11:01 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Converted 1024.00 MB image at 98.06 MB/s Nov 02 10:11:01 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:11:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:01 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 Nov 02 10:11:01 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:02 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" returned: 0 in 0.417s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" released by "_copy_volume_from_snapshot" :: held 12.339s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Acquiring lock "cinder-quobyte-d380ec2b-0bf3-4bec-ad26-b237b6861d27" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-d380ec2b-0bf3-4bec-ad26-b237b6861d27" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Deleting offline snapshot d380ec2b-0bf3-4bec-ad26-b237b6861d27 of volume 2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] snapshot_file for this snap is: volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1032ffc0-e825-4c87-9b84-11eed3cf7cae]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:02 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 Nov 02 10:11:02 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:03 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27" returned: 0 in 0.768s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:03 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa23b48a-4a0e-46db-8587-6ff4f83118b2]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:03 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 Nov 02 10:11:03 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:04 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" returned: 0 in 0.827s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:04 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 Nov 02 10:11:04 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:04 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27" returned: 0 in 0.682s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:04 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27 Nov 02 10:11:04 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-15750bc1-1ff8-4bf6-bbd3-b60a6f274252 tempest-GroupSnapshotsV319Test-2079564472 None] Group tempest-GroupSnapshotsV319Test-Group-1967381408: creating Nov 02 10:11:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-15750bc1-1ff8-4bf6-bbd3-b60a6f274252 tempest-GroupSnapshotsV319Test-2079564472 None] Group tempest-GroupSnapshotsV319Test-Group-1967381408: created successfully Nov 02 10:11:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-15750bc1-1ff8-4bf6-bbd3-b60a6f274252 tempest-GroupSnapshotsV319Test-2079564472 None] Create group completed successfully. Nov 02 10:11:05 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9.d380ec2b-0bf3-4bec-ad26-b237b6861d27" returned: 0 in 0.401s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-d380ec2b-0bf3-4bec-ad26-b237b6861d27" released by "_delete_snapshot" :: held 2.882s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.148s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-aadf1f95-fd07-4afd-ad17-a9f7583427a0 req-cad231c6-fc5c-40c7-9e74-b48705521557 tempest-TestShelveInstance-1403493392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.644s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-aadf1f95-fd07-4afd-ad17-a9f7583427a0 req-cad231c6-fc5c-40c7-9e74-b48705521557 tempest-TestShelveInstance-1403493392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-aadf1f95-fd07-4afd-ad17-a9f7583427a0 req-cad231c6-fc5c-40c7-9e74-b48705521557 tempest-TestShelveInstance-1403493392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-82fb4426-a502-471e-80f5-06dc7947230c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '615011d6-7c21-4099-8f05-4ed0bc041894', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:11:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-af6523c6-a0da-4be3-bf8d-1c0b646a0e8f tempest-GroupsV314Test-292908799 None] Create group from source-group-b611d8c8-1233-46b8-b5a6-b25bc36233cf completed successfully. Nov 02 10:11:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-aadf1f95-fd07-4afd-ad17-a9f7583427a0 req-cad231c6-fc5c-40c7-9e74-b48705521557 tempest-TestShelveInstance-1403493392 None] attachment_update completed successfully. Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Flow 'volume_create_manager' (e0b36f27-ae8a-449e-9721-0a3b593fe6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579e387f-445d-42d8-8b41-8a916830c4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579e387f-445d-42d8-8b41-8a916830c4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095816854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dde64e3-a915-4c4f-89ce-fa58c0b85a61,host='devstack@QuobyteHD#QuobyteHD',id=fd91fd17-1ceb-4a85-b88c-48bf5be841ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d9165357114b578d79e67456ac3653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:06Z,use_quota=True,user_id='85087a2e61f6434f94329326b6c9fa1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(624a8683-6328-4497-a61c-cf2e0f810b47),volume_type_id=624a8683-6328-4497-a61c-cf2e0f810b47)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390ff17b-5c8d-4de5-b1c6-43c07776fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390ff17b-5c8d-4de5-b1c6-43c07776fdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f314c6b-4e54-4547-a82b-84996780e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f314c6b-4e54-4547-a82b-84996780e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd91fd17-1ceb-4a85-b88c-48bf5be841ab', 'volume_name': 'volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db47d5bb-a27e-499c-8c4d-213dfb155ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db47d5bb-a27e-499c-8c4d-213dfb155ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73398f08-3076-4d7c-99ad-53e9326e57c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:06 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Volume fd91fd17-1ceb-4a85-b88c-48bf5be841ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab', 'volume_size': 1} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8dde64e3-a915-4c4f-89ce-fa58c0b85a61,created_at=2026-11-02T09:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095816854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dde64e3-a915-4c4f-89ce-fa58c0b85a61,host='devstack@QuobyteHD#QuobyteHD',id=fd91fd17-1ceb-4a85-b88c-48bf5be841ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d9165357114b578d79e67456ac3653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:06Z,use_quota=True,user_id='85087a2e61f6434f94329326b6c9fa1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(624a8683-6328-4497-a61c-cf2e0f810b47),volume_type_id=624a8683-6328-4497-a61c-cf2e0f810b47)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Creating volume fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:06 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:11:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:06 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab 1073741824 Nov 02 10:11:06 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Acquiring lock "cinder-quobyte-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" acquired by "delete_volume" :: waited 0.046s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4124cd-768d-420d-b739-e1b11c3aaf25]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:07 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab 1073741824" returned: 0 in 1.036s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:07 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab Nov 02 10:11:07 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:08 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 Nov 02 10:11:08 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:08 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" returned: 0 in 0.441s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73398f08-3076-4d7c-99ad-53e9326e57c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbd3104-f95b-4fe6-9791-ba1e4fa77031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:08 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Volume volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab (fd91fd17-1ceb-4a85-b88c-48bf5be841ab): created successfully Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbd3104-f95b-4fe6-9791-ba1e4fa77031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Flow 'volume_create_manager' (e0b36f27-ae8a-449e-9721-0a3b593fe6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:08 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" returned: 0 in 0.668s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cd5d0125-5ada-41fa-bcd2-e5bd17166e54 tempest-GroupSnapshotsV319Test-2079564472 None] Created volume successfully. Nov 02 10:11:08 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1 Nov 02 10:11:08 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:08 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" returned: 0 in 0.347s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-d2d23352-0cc6-4a9d-b6d7-96bdacb15af1" released by "delete_volume" :: held 1.100s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:08 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Created reservations ['76065253-9b4a-4d1a-bdfc-8f620f997a5e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:09 devstack cinder-volume[87005]: WARNING cinder.quota [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-799751298 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-799751298, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:11:09 devstack cinder-volume[87005]: WARNING cinder.quota [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-799751298 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-799751298, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:11:09 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Created reservations ['4766f991-5d24-41e3-bc3f-f3e9ed8f01ee', '1292ca3e-56c9-4fe1-bbb5-b9e298b75bea', '3104a2ac-28f0-435a-8df7-7ce56655fef2', '666744b3-73a9-488f-837f-e6b9596560a9'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:09 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:11:09 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] GroupSnapshot 8d6e9448-1021-445a-8fcf-9ee589e5b52c: creating. Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Group snapshot 8d6e9448-1021-445a-8fcf-9ee589e5b52c: creating. {{(pid=87005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Creating offline snapshot 130eb976-8417-4963-a10a-b79c55fc2570 of volume fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d59b22-ebd7-4eea-ac4e-59f9f8ba229d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:10 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.704s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:10 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fa4a1a36-5ec1-424c-b4e2-60d8d43c86f0 tempest-GroupsV314Test-292908799 None] Delete group completed successfully. Nov 02 10:11:10 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab Nov 02 10:11:10 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:10 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" returned: 0 in 0.693s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:10 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 1G Nov 02 10:11:10 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Acquiring lock "cinder-quobyte-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" acquired by "delete_volume" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d460d89-bb08-4b92-bc6b-d494d64fb224]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:11 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 Nov 02 10:11:11 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:11 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 1G" returned: 0 in 0.982s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:11 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 Nov 02 10:11:11 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:12 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" returned: 0 in 0.852s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:12 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9 Nov 02 10:11:12 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:12 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570" returned: 0 in 0.657s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:12 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:11:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:12 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 Nov 02 10:11:12 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:12 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" returned: 0 in 0.497s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Lock "cinder-quobyte-2640d7c7-6e6e-4d1c-af77-2f40eb72b1e9" released by "delete_volume" :: held 1.490s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Created reservations ['88f2856c-75a8-438f-9ff9-a2e15f51e9ed'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:13 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570" returned: 0 in 0.601s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Created reservations ['849646d1-6192-4c4c-b7b7-b85c99db7ae6', '855100a8-a0d3-4a75-b818-b365ea88f207', '9a3f39e1-a4d7-4f0f-b83b-42b5f06550f8', '82ee14ef-4967-4244-a707-42daa20aa2c6'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:13 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.info Nov 02 10:11:13 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:13 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:11:13 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:13 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.info" returned: 0 in 0.471s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:13 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:13 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.info Nov 02 10:11:13 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:13 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.405s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:13 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:13 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-890d2e2c-0a9e-4b1f-a952-28bc9d8406bf tempest-GroupsV314Test-292908799 None] Delete group completed successfully. Nov 02 10:11:14 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.info" returned: 0 in 0.678s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.279s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-55fe0673-8126-4afb-a52f-806329526d71 tempest-GroupSnapshotsV319Test-2079564472 None] group_snapshot 8d6e9448-1021-445a-8fcf-9ee589e5b52c: created successfully Nov 02 10:11:17 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] group_snapshot 8d6e9448-1021-445a-8fcf-9ee589e5b52c: deleting Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] group_snapshot 8d6e9448-1021-445a-8fcf-9ee589e5b52c: deleting {{(pid=87005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Acquiring lock "cinder-quobyte-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "cinder-quobyte-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Acquiring lock "cinder-quobyte-130eb976-8417-4963-a10a-b79c55fc2570" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "cinder-quobyte-130eb976-8417-4963-a10a-b79c55fc2570" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Deleting offline snapshot 130eb976-8417-4963-a10a-b79c55fc2570 of volume fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] snapshot_file for this snap is: volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[42607a74-bae2-4d4d-954a-ca1dfa17aaf1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:17 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 Nov 02 10:11:17 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:17 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570" returned: 0 in 0.572s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df175eb-c8f8-47f0-8a8a-3811aa3cf445]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:18 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab Nov 02 10:11:18 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:18 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" returned: 0 in 0.562s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:18 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 Nov 02 10:11:18 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:18 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570" returned: 0 in 0.502s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:19 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570 Nov 02 10:11:19 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:19 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab.130eb976-8417-4963-a10a-b79c55fc2570" returned: 0 in 0.376s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "cinder-quobyte-130eb976-8417-4963-a10a-b79c55fc2570" released by "_delete_snapshot" :: held 2.185s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Lock "cinder-quobyte-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" released by "delete_snapshot" :: held 2.244s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:19 devstack cinder-volume[87005]: WARNING cinder.quota [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-591768927 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-591768927, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:11:19 devstack cinder-volume[87005]: WARNING cinder.quota [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-591768927 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-591768927, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:11:19 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] Created reservations ['a098fd7f-d9ee-45e2-b0ca-f5562d1c3b2f', '1d8c82fb-cc4d-4f8d-a280-3426774eefde', '2d6d602b-1ca2-448f-ae83-86598063a827', '26c13f03-eb36-43c5-8e7a-2859fc813d35'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-57676116-1213-4561-b70d-3ea17760a589 tempest-GroupSnapshotsV319Test-2079564472 None] group_snapshot 8d6e9448-1021-445a-8fcf-9ee589e5b52c: deleted successfully Nov 02 10:11:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Acquiring lock "cinder-quobyte-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Lock "cinder-quobyte-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" acquired by "delete_volume" :: waited 0.043s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450e852-2d51-4318-b276-ca8358bc72de]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:21 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab Nov 02 10:11:21 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:21 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" returned: 0 in 0.528s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:21 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab Nov 02 10:11:21 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:22 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" returned: 0 in 0.504s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Lock "cinder-quobyte-fd91fd17-1ceb-4a85-b88c-48bf5be841ab" released by "delete_volume" :: held 1.175s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Created reservations ['362e8cc3-1741-47d8-80b9-94f7e1bca36d'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:22 devstack cinder-volume[87005]: WARNING cinder.quota [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-591768927 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-591768927, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Created reservations ['8fd17813-215a-45ef-93c7-684be96d43c1', '8ba73a16-9d92-43e6-9fe6-d899defecb23', '9b6a08b0-6386-4c61-b60d-6e341b4b0c66', '1c79232e-5be2-4d92-827b-7f06f4486de8'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:22 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:11:22 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:23 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.324s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:23 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-636a5c13-bc39-4d85-9a51-053d5f9727ee tempest-GroupSnapshotsV319Test-2079564472 None] Delete group completed successfully. Nov 02 10:11:23 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Flow 'volume_create_manager' (50f7ac32-cb2f-4b6c-9a2e-a113b4abb828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88e0b3f-e514-48a9-9b5a-92263e84510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88e0b3f-e514-48a9-9b5a-92263e84510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-225500316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9865eb-35ff-46cb-8229-d29ef13e3a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c345d0fd22d44d9a7d771dd3e1a0281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:24Z,use_quota=True,user_id='b558b2c3202b4fb9abab7f0ff1416432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d5bda1-eee5-4be7-a4b8-1b20f6d195c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d5bda1-eee5-4be7-a4b8-1b20f6d195c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e051e01-b79f-4adc-a3d0-431c3d2a8b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e051e01-b79f-4adc-a3d0-431c3d2a8b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9865eb-35ff-46cb-8229-d29ef13e3a9b', 'volume_name': 'volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e8c8b2-3744-4f25-9fb0-05196b88e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e8c8b2-3744-4f25-9fb0-05196b88e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a816d04e-c4be-4723-b84f-a218edc7d6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Volume be9865eb-35ff-46cb-8229-d29ef13e3a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b', 'volume_size': 1} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-225500316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9865eb-35ff-46cb-8229-d29ef13e3a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c345d0fd22d44d9a7d771dd3e1a0281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:24Z,use_quota=True,user_id='b558b2c3202b4fb9abab7f0ff1416432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Creating volume be9865eb-35ff-46cb-8229-d29ef13e3a9b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:24 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:24 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b 1073741824 Nov 02 10:11:24 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:24 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b 1073741824" returned: 0 in 0.612s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:24 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b Nov 02 10:11:24 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:25 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a816d04e-c4be-4723-b84f-a218edc7d6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93944e86-a20b-4471-b571-4be0e3a4ae0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Volume volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b (be9865eb-35ff-46cb-8229-d29ef13e3a9b): created successfully Nov 02 10:11:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93944e86-a20b-4471-b571-4be0e3a4ae0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Flow 'volume_create_manager' (50f7ac32-cb2f-4b6c-9a2e-a113b4abb828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6ed8601b-201c-41f3-90a0-7a266caa3103 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Created volume successfully. Nov 02 10:11:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Acquiring lock "cinder-be9865eb-35ff-46cb-8229-d29ef13e3a9b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "cinder-be9865eb-35ff-46cb-8229-d29ef13e3a9b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Acquiring lock "cinder-quobyte-be9865eb-35ff-46cb-8229-d29ef13e3a9b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "cinder-quobyte-be9865eb-35ff-46cb-8229-d29ef13e3a9b" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:28 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c586d7c-91cf-4597-88d3-0958562b7747]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:28 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b Nov 02 10:11:28 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:28 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b" returned: 0 in 0.476s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:28 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b Nov 02 10:11:28 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:28 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be9865eb-35ff-46cb-8229-d29ef13e3a9b" returned: 0 in 0.317s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "cinder-quobyte-be9865eb-35ff-46cb-8229-d29ef13e3a9b" released by "delete_volume" :: held 0.862s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:28 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Created reservations ['7efacd93-979b-4fa8-888e-f9303dde83bc', 'eb34125c-5b05-4cde-a60e-435f07a14728', 'a6ecb79e-674a-4d35-bf0d-f41ab70a4b0f', '2ad7513f-5292-428b-929b-e0ddd941cd3e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:29 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:11:29 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:29 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.282s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Deleted volume successfully. Nov 02 10:11:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3453c105-f4f3-4944-8c30-b3ebce202907 tempest-VolumeQuotasNegativeTestJSON-1303556975 None] Lock "cinder-be9865eb-35ff-46cb-8229-d29ef13e3a9b-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:39 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=100,cinder:SELECT=101,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:39 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=95,cinder:INSERT=29,cinder:UPDATE=95,cinder:DELETE=4 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Flow 'volume_create_manager' (3e76d760-4694-45a1-9a04-30f4dd011279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c89282-0d7e-47b6-a0f6-d7dcd5d210df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c89282-0d7e-47b6-a0f6-d7dcd5d210df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-148419433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e6d1f-887a-4d88-9e8b-2faedcf862d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c8f15fc0664ffa9347a73fc57355b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:45Z,use_quota=True,user_id='a6e461b917114570a3cb6e38e71a7004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea28189-8f15-4db1-a8d3-311322b8c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea28189-8f15-4db1-a8d3-311322b8c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e34c5f-d04a-4092-9d0a-55409f465de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e34c5f-d04a-4092-9d0a-55409f465de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '871e6d1f-887a-4d88-9e8b-2faedcf862d9', 'volume_name': 'volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065bae62-7e5d-41aa-bdbf-c31c0a75aec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065bae62-7e5d-41aa-bdbf-c31c0a75aec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372ce00d-c430-4781-9795-dc395dc6dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Volume 871e6d1f-887a-4d88-9e8b-2faedcf862d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Trying to clone 871e6d1f-887a-4d88-9e8b-2faedcf862d9 from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:11:45 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249f082-5d8d-4eb3-ba4a-994d84b6206a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:46 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD Nov 02 10:11:46 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:46 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 is fetched for user a6e461b917114570a3cb6e38e71a7004. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9708f0ad-1fb1-4022-a38c-c0fe9e65326f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:46 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD Nov 02 10:11:46 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:46 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-148419433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e6d1f-887a-4d88-9e8b-2faedcf862d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c8f15fc0664ffa9347a73fc57355b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:45Z,use_quota=True,user_id='a6e461b917114570a3cb6e38e71a7004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Creating volume 871e6d1f-887a-4d88-9e8b-2faedcf862d9 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:46 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:11:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:46 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 1073741824 Nov 02 10:11:46 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:47 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 1073741824" returned: 0 in 0.576s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:47 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 Nov 02 10:11:47 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:47 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9" returned: 0 in 0.410s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Attempting download of 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume 871e6d1f-887a-4d88-9e8b-2faedcf862d9. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[27573c58-7b2e-468c-81db-b34099b94e23]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_15gqstlr {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:48 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_15gqstlr Nov 02 10:11:48 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:48 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_15gqstlr" returned: 0 in 0.419s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_15gqstlr {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:48 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_15gqstlr Nov 02 10:11:48 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:48 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_15gqstlr" returned: 1 in 0.500s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_15gqstlr' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc317d3f-99ce-4979-95ba-99223aab08d1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:48 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:11:48 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:49 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD Nov 02 10:11:49 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:49 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.426s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:11:49 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] 4e759a38-67b9-4ba7-b77d-917ff16305f2 was qcow2, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:11:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:49 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 Nov 02 10:11:49 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-5150cacd-d85c-40b9-aedb-6e45f8cdfc72 req-67ad992d-d34e-424a-b625-98f820d16a2b tempest-TestMinimumBasicScenario-150843868 None] Terminate volume connection completed successfully. Nov 02 10:11:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-5150cacd-d85c-40b9-aedb-6e45f8cdfc72 req-67ad992d-d34e-424a-b625-98f820d16a2b tempest-TestMinimumBasicScenario-150843868 None] Deleting attachment 6c13c7c1-35bc-4406-89ba-d1f0c6d36edf. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Acquiring lock "cinder-4c69e076-ae2a-452c-8526-fc932ce5f746-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Lock "cinder-4c69e076-ae2a-452c-8526-fc932ce5f746-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Acquiring lock "cinder-quobyte-4c69e076-ae2a-452c-8526-fc932ce5f746" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:52 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Lock "cinder-quobyte-4c69e076-ae2a-452c-8526-fc932ce5f746" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9" returned: 0 in 2.836s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_oo9ejdrudevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:11:52 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Converted 112.00 MB image at 39.47 MB/s Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2d296-42ba-4faf-af20-26d199c29caf]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:52 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 1G Nov 02 10:11:52 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:52 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 Nov 02 10:11:52 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:52 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 1G" returned: 0 in 0.506s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Downloaded image 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume 871e6d1f-887a-4d88-9e8b-2faedcf862d9 successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 for user a6e461b917114570a3cb6e38e71a7004 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Marking volume 871e6d1f-887a-4d88-9e8b-2faedcf862d9 as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Copying metadata from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 to 871e6d1f-887a-4d88-9e8b-2faedcf862d9. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Creating volume glance metadata for volume 871e6d1f-887a-4d88-9e8b-2faedcf862d9 backed by image 4e759a38-67b9-4ba7-b77d-917ff16305f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:11:52 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746" returned: 0 in 0.537s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:52 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746 Nov 02 10:11:52 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372ce00d-c430-4781-9795-dc395dc6dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b01e7ee-c268-4ec6-8a98-564dc7fa8e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:52 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Volume volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 (871e6d1f-887a-4d88-9e8b-2faedcf862d9): created successfully Nov 02 10:11:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b01e7ee-c268-4ec6-8a98-564dc7fa8e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Flow 'volume_create_manager' (3e76d760-4694-45a1-9a04-30f4dd011279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f00f006d-3785-4ed0-affc-aecbd0095796 tempest-VolumesImageMetadata-1772029546 None] Created volume successfully. Nov 02 10:11:53 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4c69e076-ae2a-452c-8526-fc932ce5f746" returned: 0 in 0.470s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Lock "cinder-quobyte-4c69e076-ae2a-452c-8526-fc932ce5f746" released by "delete_volume" :: held 1.087s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Created reservations ['df5e6464-50ad-4734-b7cf-cfa942c5dc89', '31b486fb-dd71-46fe-b8e5-756459fc17db', '460a10bb-80ab-42a6-a5d9-5682ea22fa93', '306d45b2-c487-4d1d-898e-2a698cb4055b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:53 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:11:53 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:53 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.316s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Deleted volume successfully. Nov 02 10:11:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-238eb1d2-df83-4503-8bdd-4eaf7da2f245 tempest-TestMinimumBasicScenario-150843868 None] Lock "cinder-4c69e076-ae2a-452c-8526-fc932ce5f746-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Acquiring lock "cinder-871e6d1f-887a-4d88-9e8b-2faedcf862d9-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Lock "cinder-871e6d1f-887a-4d88-9e8b-2faedcf862d9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Acquiring lock "cinder-quobyte-871e6d1f-887a-4d88-9e8b-2faedcf862d9" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Lock "cinder-quobyte-871e6d1f-887a-4d88-9e8b-2faedcf862d9" acquired by "delete_volume" :: waited 0.050s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5762261-b905-440f-88fe-85f621a21dff]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-36e1e377-0a0d-4b8e-b03d-479b2a5c9472 req-da73a770-55e3-46e3-900e-68454779a431 tempest-TestShelveInstance-1403493392 None] Terminate volume connection completed successfully. Nov 02 10:11:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-36e1e377-0a0d-4b8e-b03d-479b2a5c9472 req-da73a770-55e3-46e3-900e-68454779a431 tempest-TestShelveInstance-1403493392 None] Deleting attachment 615011d6-7c21-4099-8f05-4ed0bc041894. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:11:55 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 Nov 02 10:11:55 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:55 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9" returned: 0 in 0.830s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:55 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9 Nov 02 10:11:55 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Flow 'volume_create_manager' (893e8f33-3824-49ce-85e5-bdc343079cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459953c2-95bc-478e-a7aa-74c676de026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:56 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-871e6d1f-887a-4d88-9e8b-2faedcf862d9" returned: 0 in 0.537s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Lock "cinder-quobyte-871e6d1f-887a-4d88-9e8b-2faedcf862d9" released by "delete_volume" :: held 1.473s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459953c2-95bc-478e-a7aa-74c676de026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-764809713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d535447-1f3c-4daf-aebd-dd5c2aedd23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b780ef5f714095a749a9269577029e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:56Z,use_quota=True,user_id='ef6fa6c929a94dae9711ebf37f87acba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725d4ce3-fdaa-4e18-8921-c8df20e25dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725d4ce3-fdaa-4e18-8921-c8df20e25dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa2cc36-692c-4a1e-9f0d-5b950136ad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa2cc36-692c-4a1e-9f0d-5b950136ad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d535447-1f3c-4daf-aebd-dd5c2aedd23b', 'volume_name': 'volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d41547a-28f1-4e16-8590-20a443afb833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d41547a-28f1-4e16-8590-20a443afb833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c914c5f-d707-4ad6-a15e-b321f059b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:56 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Volume 0d535447-1f3c-4daf-aebd-dd5c2aedd23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b', 'volume_size': 1} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-764809713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d535447-1f3c-4daf-aebd-dd5c2aedd23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b780ef5f714095a749a9269577029e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:56Z,use_quota=True,user_id='ef6fa6c929a94dae9711ebf37f87acba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Creating volume 0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:56 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:56 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b 1073741824 Nov 02 10:11:56 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Created reservations ['22a6da63-0d26-4e33-8557-cd9a85ec15d3', 'fa240ba8-997b-405a-8b87-ae31339926b5', 'f17287f5-d3a1-458b-90e9-8acbf22d30e2', '86e6add4-a62d-43c8-b08b-d2559321d9b3'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:56 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:11:56 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:57 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.572s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Deleted volume successfully. Nov 02 10:11:57 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b 1073741824" returned: 0 in 0.841s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c17639f0-63a5-4509-97c5-d61ec7120acd tempest-VolumesImageMetadata-1772029546 None] Lock "cinder-871e6d1f-887a-4d88-9e8b-2faedcf862d9-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:57 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b Nov 02 10:11:57 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:57 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" returned: 0 in 0.424s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c914c5f-d707-4ad6-a15e-b321f059b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ffb2df-58df-4de0-94d3-6506dc91584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:57 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Volume volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b (0d535447-1f3c-4daf-aebd-dd5c2aedd23b): created successfully Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ffb2df-58df-4de0-94d3-6506dc91584a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Flow 'volume_create_manager' (893e8f33-3824-49ce-85e5-bdc343079cc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-03027466-8f83-4daf-a702-4067fefa8669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Created volume successfully. Nov 02 10:11:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Creating offline snapshot 1886d165-7f2f-4141-889f-be5fb1781025 of volume 0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:11:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10589f3-e1b4-4b5f-806a-97fc639a2c15]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:58 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b Nov 02 10:11:58 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:59 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" returned: 0 in 0.469s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:59 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 1G Nov 02 10:11:59 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d6b6cfe6-b36f-4638-a811-b0a81317d3b8 req-56fddf59-749b-4223-b24c-90e66794a2fd tempest-TestShelveInstance-1403493392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:59 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 1G" returned: 0 in 0.628s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:59 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 Nov 02 10:11:59 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:00 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025" returned: 0 in 0.354s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:00 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 is being set with open permissions: ugo+rw Nov 02 10:12:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:00 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 Nov 02 10:12:00 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:00 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025" returned: 0 in 0.305s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:00 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.info Nov 02 10:12:00 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:00 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.info" returned: 0 in 0.362s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:00 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.info is being set with open permissions: ugo+rw Nov 02 10:12:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:00 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.info Nov 02 10:12:00 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:01 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.info" returned: 0 in 0.296s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d6b6cfe6-b36f-4638-a811-b0a81317d3b8 req-56fddf59-749b-4223-b24c-90e66794a2fd tempest-TestShelveInstance-1403493392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.612s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-d6b6cfe6-b36f-4638-a811-b0a81317d3b8 req-56fddf59-749b-4223-b24c-90e66794a2fd tempest-TestShelveInstance-1403493392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-33cd3c28-56b2-417b-b250-4377c8de58cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Create snapshot completed successfully Nov 02 10:12:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-d6b6cfe6-b36f-4638-a811-b0a81317d3b8 req-56fddf59-749b-4223-b24c-90e66794a2fd tempest-TestShelveInstance-1403493392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-82fb4426-a502-471e-80f5-06dc7947230c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b52e87f6-ef3d-4158-80ec-365489508df3', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:12:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-d6b6cfe6-b36f-4638-a811-b0a81317d3b8 req-56fddf59-749b-4223-b24c-90e66794a2fd tempest-TestShelveInstance-1403493392 None] attachment_update completed successfully. Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "cinder-1886d165-7f2f-4141-889f-be5fb1781025-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Flow 'volume_create_manager' (b09e490f-ec6c-45b4-9b4b-cb432aa73ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6176c06-4f9d-4fee-b07f-d54c6448ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-1886d165-7f2f-4141-889f-be5fb1781025-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "cinder-quobyte-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6176c06-4f9d-4fee-b07f-d54c6448ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-140443340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a70e5b-aa65-4ace-a91e-ae9ec425c791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a6dacade3242d1b7d6ae198f543480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:03Z,use_quota=True,user_id='d4f4b467e3584f6c9fb937c3157eb3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55100ccc-7abe-4318-855c-5abcd993ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55100ccc-7abe-4318-855c-5abcd993ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ed33d-216a-4750-a986-b312ade85fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ed33d-216a-4750-a986-b312ade85fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a70e5b-aa65-4ace-a91e-ae9ec425c791', 'volume_name': 'volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba336db-1101-4734-9986-5c8f4d7e6f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba336db-1101-4734-9986-5c8f4d7e6f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a868f13a-9995-40a1-a47e-651588e5202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:02 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Volume d5a70e5b-aa65-4ace-a91e-ae9ec425c791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791', 'volume_size': 1} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-140443340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a70e5b-aa65-4ace-a91e-ae9ec425c791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a6dacade3242d1b7d6ae198f543480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:03Z,use_quota=True,user_id='d4f4b467e3584f6c9fb937c3157eb3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Creating volume d5a70e5b-aa65-4ace-a91e-ae9ec425c791 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:02 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-quobyte-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" acquired by "delete_snapshot" :: waited 0.101s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "cinder-quobyte-1886d165-7f2f-4141-889f-be5fb1781025" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:02 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 1073741824 Nov 02 10:12:02 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-quobyte-1886d165-7f2f-4141-889f-be5fb1781025" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Deleting offline snapshot 1886d165-7f2f-4141-889f-be5fb1781025 of volume 0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] snapshot_file for this snap is: volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f0164-d68c-4c27-8e03-3888f33639fa]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:02 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 Nov 02 10:12:02 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:03 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 1073741824" returned: 0 in 0.667s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:03 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025" returned: 0 in 0.676s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:12:03 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 Nov 02 10:12:03 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3e587-a2be-4451-9f1e-cb4f7c61d0c1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:03 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b Nov 02 10:12:03 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:03 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a868f13a-9995-40a1-a47e-651588e5202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e83bc39-a9fd-452b-80cb-437bd1f2ed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:03 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Volume volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 (d5a70e5b-aa65-4ace-a91e-ae9ec425c791): created successfully Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e83bc39-a9fd-452b-80cb-437bd1f2ed57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Flow 'volume_create_manager' (b09e490f-ec6c-45b4-9b4b-cb432aa73ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-89c5477f-e58b-42fb-925f-b5149289cd25 tempest-VolumesMetadataTest-960900961 None] Created volume successfully. Nov 02 10:12:04 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" returned: 0 in 0.517s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:04 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 Nov 02 10:12:04 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:04 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025" returned: 0 in 0.518s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:04 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025 Nov 02 10:12:04 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:05 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b.1886d165-7f2f-4141-889f-be5fb1781025" returned: 0 in 0.407s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-quobyte-1886d165-7f2f-4141-889f-be5fb1781025" released by "_delete_snapshot" :: held 2.331s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-quobyte-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" released by "delete_snapshot" :: held 2.367s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:05 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Created reservations ['8b14dc57-d0c1-4939-8413-9d99873fb3e0', 'dc509dea-5ab4-4ee5-9a7d-9b284183a2f8', '49250517-1292-42ab-80e0-434fd326684d', '680756b4-e372-4318-894b-b82edecacb5a'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Delete snapshot completed successfully. Nov 02 10:12:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c82681eb-b91d-48f7-bba7-ea49fa287fe6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-1886d165-7f2f-4141-889f-be5fb1781025-delete_snapshot" released by "delete_snapshot" :: held 2.872s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "cinder-0d535447-1f3c-4daf-aebd-dd5c2aedd23b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-0d535447-1f3c-4daf-aebd-dd5c2aedd23b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "cinder-quobyte-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-quobyte-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Acquiring lock "cinder-d5a70e5b-aa65-4ace-a91e-ae9ec425c791-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df0f75-126d-4614-9d1e-d6ea7b8f75ef]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Lock "cinder-d5a70e5b-aa65-4ace-a91e-ae9ec425c791-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Acquiring lock "cinder-quobyte-d5a70e5b-aa65-4ace-a91e-ae9ec425c791" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Lock "cinder-quobyte-d5a70e5b-aa65-4ace-a91e-ae9ec425c791" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[db12a78e-1036-4aec-9658-fa5c052bbc3d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:06 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b Nov 02 10:12:06 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:06 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 Nov 02 10:12:06 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:07 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" returned: 0 in 0.736s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:07 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b Nov 02 10:12:07 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:07 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791" returned: 0 in 0.836s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:07 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791 Nov 02 10:12:07 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:07 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" returned: 0 in 0.784s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-quobyte-0d535447-1f3c-4daf-aebd-dd5c2aedd23b" released by "delete_volume" :: held 1.697s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:07 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d5a70e5b-aa65-4ace-a91e-ae9ec425c791" returned: 0 in 0.491s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Lock "cinder-quobyte-d5a70e5b-aa65-4ace-a91e-ae9ec425c791" released by "delete_volume" :: held 1.444s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Created reservations ['026928d2-4ce8-48c0-9fbe-d954c52c6955', '229d2e0d-9e71-4323-baf3-07bac7659456', 'cbcdcc66-d1df-49b3-a2e7-08f66e1f3df7', '3b750f9a-3917-420c-95d0-9c947152af83'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Created reservations ['5e97f9f9-1320-4a7c-b01c-f8709eb53339', '31f42897-d3a3-4ac0-b817-5c1d9341ce45', '875cac07-ddbe-4f94-bbcb-dbdf2aa97c12', '22ff5fa2-a278-402d-89c1-b8f6e45aad06'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:08 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:08 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:08 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:08 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:08 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.613s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Deleted volume successfully. Nov 02 10:12:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-202b408e-f4df-4ac2-925e-76badf1f1db0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026605081 None] Lock "cinder-0d535447-1f3c-4daf-aebd-dd5c2aedd23b-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:09 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.652s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:09 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Deleted volume successfully. Nov 02 10:12:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7fe290d2-dcff-4a24-a7a9-1b17670fdb49 tempest-VolumesMetadataTest-960900961 None] Lock "cinder-d5a70e5b-aa65-4ace-a91e-ae9ec425c791-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Flow 'volume_create_manager' (7aca6ad3-552d-4a48-a04a-fbfb4e9c8272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9913d2-e648-4e74-9a13-c2a139551b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9913d2-e648-4e74-9a13-c2a139551b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1660083813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e4a0a6-8685-494a-be55-cc82547ecdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184dd11b4fbd42c69ec19e365f5f2822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:18Z,use_quota=True,user_id='668b479135424e22ac8efa44fabd2f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b4719-8989-4c89-a039-1b7e46d48e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b4719-8989-4c89-a039-1b7e46d48e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c029cbc0-50ad-4833-b828-62369090d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c029cbc0-50ad-4833-b828-62369090d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e4a0a6-8685-494a-be55-cc82547ecdaf', 'volume_name': 'volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7c64d0-b565-4308-a46e-115ba61f628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7c64d0-b565-4308-a46e-115ba61f628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9bdfe3-85f5-4cdc-b1ae-45a10facd151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:18 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Volume a2e4a0a6-8685-494a-be55-cc82547ecdaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf', 'volume_size': 1} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1660083813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e4a0a6-8685-494a-be55-cc82547ecdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184dd11b4fbd42c69ec19e365f5f2822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:18Z,use_quota=True,user_id='668b479135424e22ac8efa44fabd2f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Creating volume a2e4a0a6-8685-494a-be55-cc82547ecdaf {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:18 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:18 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf 1073741824 Nov 02 10:12:18 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:19 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf 1073741824" returned: 0 in 0.638s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:19 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf Nov 02 10:12:19 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:19 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf" returned: 0 in 0.362s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9bdfe3-85f5-4cdc-b1ae-45a10facd151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dc611f-ef64-48df-bb3d-0b5180a6c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Volume volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf (a2e4a0a6-8685-494a-be55-cc82547ecdaf): created successfully Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dc611f-ef64-48df-bb3d-0b5180a6c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Flow 'volume_create_manager' (7aca6ad3-552d-4a48-a04a-fbfb4e9c8272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e00c6a38-0b86-4bd1-8501-ef7740260718 tempest-VolumesTransfersV357Test-1720361918 None] Created volume successfully. Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Flow 'volume_create_manager' (bdc7b196-e43c-4fcd-a4ca-33365c324f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c7ce84-1037-455c-8eae-563719c1c6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c7ce84-1037-455c-8eae-563719c1c6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-812595148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff381862-70fb-473f-8b9e-4ed95364473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ee1dd878c493692207563e92f6f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:20Z,use_quota=True,user_id='422e316efff7438eb72769c0f2e90340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe751112-3f4f-4e81-955a-f358a733ec3b),volume_type_id=fe751112-3f4f-4e81-955a-f358a733ec3b)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b0f54-603b-4ee1-8c02-11d32f8164eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b0f54-603b-4ee1-8c02-11d32f8164eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65809be1-e31f-419f-843d-917cd7dbc7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65809be1-e31f-419f-843d-917cd7dbc7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff381862-70fb-473f-8b9e-4ed95364473b', 'volume_name': 'volume-ff381862-70fb-473f-8b9e-4ed95364473b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7606be-773a-4246-a3fd-cbefbb22f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7606be-773a-4246-a3fd-cbefbb22f7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f49666-3216-442f-ae03-c2fc4fed9a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:20 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Volume ff381862-70fb-473f-8b9e-4ed95364473b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff381862-70fb-473f-8b9e-4ed95364473b', 'volume_size': 1} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-812595148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff381862-70fb-473f-8b9e-4ed95364473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ee1dd878c493692207563e92f6f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:20Z,use_quota=True,user_id='422e316efff7438eb72769c0f2e90340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe751112-3f4f-4e81-955a-f358a733ec3b),volume_type_id=fe751112-3f4f-4e81-955a-f358a733ec3b)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Creating volume ff381862-70fb-473f-8b9e-4ed95364473b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:20 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:20 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b 1073741824 Nov 02 10:12:20 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:20 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b 1073741824" returned: 0 in 0.542s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:20 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b Nov 02 10:12:20 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:21 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b" returned: 0 in 0.353s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f49666-3216-442f-ae03-c2fc4fed9a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff381862-70fb-473f-8b9e-4ed95364473b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06871d7e-351b-479a-ae11-840aec55cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:21 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Volume volume-ff381862-70fb-473f-8b9e-4ed95364473b (ff381862-70fb-473f-8b9e-4ed95364473b): created successfully Nov 02 10:12:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06871d7e-351b-479a-ae11-840aec55cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Flow 'volume_create_manager' (bdc7b196-e43c-4fcd-a4ca-33365c324f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9da1226a-f6c4-4504-8ce3-153157edd274 tempest-VolumeTypesAccessTest-1418301026 None] Created volume successfully. Nov 02 10:12:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8f8db278-53c9-4453-8263-eaa16ef410d1 tempest-VolumesTransfersV357Test-1483258177 None] Transfer volume completed successfully. Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Acquiring lock "cinder-a2e4a0a6-8685-494a-be55-cc82547ecdaf-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-a2e4a0a6-8685-494a-be55-cc82547ecdaf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Acquiring lock "cinder-quobyte-a2e4a0a6-8685-494a-be55-cc82547ecdaf" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-quobyte-a2e4a0a6-8685-494a-be55-cc82547ecdaf" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed84d71-7826-48cd-94f5-0e6b86ffd242]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Acquiring lock "cinder-ff381862-70fb-473f-8b9e-4ed95364473b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Lock "cinder-ff381862-70fb-473f-8b9e-4ed95364473b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:22 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf Nov 02 10:12:22 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Acquiring lock "cinder-quobyte-ff381862-70fb-473f-8b9e-4ed95364473b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Lock "cinder-quobyte-ff381862-70fb-473f-8b9e-4ed95364473b" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5332904-145a-453a-a663-30661c84abee]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:22 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b Nov 02 10:12:22 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:22 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf" returned: 0 in 0.441s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:22 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf Nov 02 10:12:22 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:23 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b" returned: 0 in 0.496s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:23 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a2e4a0a6-8685-494a-be55-cc82547ecdaf" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:23 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b Nov 02 10:12:23 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-quobyte-a2e4a0a6-8685-494a-be55-cc82547ecdaf" released by "delete_volume" :: held 0.920s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Created reservations ['34f3ddb0-c59d-4283-9d8b-fd72aca705de', '7581c331-28ad-468d-ac5d-78ef8983af7b', '475692c1-1f71-4e7d-9a52-61898ab4ebd8', 'f1582345-0c24-4f4f-bb20-ba8069711331'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Flow 'volume_create_manager' (f95194fc-d807-4908-92e8-dd91694b9f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e10891e-7767-4d9f-a410-c496b33438eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:23 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ff381862-70fb-473f-8b9e-4ed95364473b" returned: 0 in 0.426s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:23 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:23 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e10891e-7767-4d9f-a410-c496b33438eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2a953d-2cae-495d-9c29-774361bafc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2167d91d0e6a4f7e968ed99235c75d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:23Z,use_quota=True,user_id='e499aff7eff441f89840d5f127006da1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0c3bcb-ec61-4e2a-b4c1-42f1e3a3a1cf),volume_type_id=3e0c3bcb-ec61-4e2a-b4c1-42f1e3a3a1cf)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6629fb4d-9bbe-4bdd-a0c2-f791c7a187d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6629fb4d-9bbe-4bdd-a0c2-f791c7a187d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f408b123-6689-447c-b685-431eadaa7e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Lock "cinder-quobyte-ff381862-70fb-473f-8b9e-4ed95364473b" released by "delete_volume" :: held 1.009s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:23 devstack cinder-volume[87005]: WARNING cinder.quota [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-538616405 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-538616405, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:23 devstack cinder-volume[87005]: WARNING cinder.quota [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-538616405 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-538616405, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Created reservations ['10390eb6-b49e-4085-b863-363e20d3a9b7', '514ce608-bbf6-4974-be67-99edc9b4d070', '0e5d3b63-6891-4e7f-bd0d-3f37b025b420', '94cec481-9dae-4763-893a-b96c18ca9bf4'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:23 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:23 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:23 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.331s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Deleted volume successfully. Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8422ae8a-304c-4a82-a3a2-e1ed73d501a6 tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-a2e4a0a6-8685-494a-be55-cc82547ecdaf-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f408b123-6689-447c-b685-431eadaa7e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b2a953d-2cae-495d-9c29-774361bafc6b', 'volume_name': 'volume-2b2a953d-2cae-495d-9c29-774361bafc6b', 'volume_size': 1, 'image_id': '6d1218b5-133d-4391-ad76-b4b7a956a33c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d1218b5-133d-4391-ad76-b4b7a956a33c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '157ee64b295b28c34d4d197d3ad13943', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2167d91d0e6a4f7e968ed99235c75d8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf4e9531c15e794136944571703f1cd994b3665ff031134423f374cdf1a1f647d995e00bf23e966650813b24381d02c6a1320a2e85f8d7fa4aa6ca1d81d5cf6d', 'id': '6d1218b5-133d-4391-ad76-b4b7a956a33c', 'created_at': datetime.datetime(2026, 11, 2, 9, 12, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 12, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d1218b5-133d-4391-ad76-b4b7a956a33c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1f07f5-6bd8-41d6-9808-b041321ce0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1f07f5-6bd8-41d6-9808-b041321ce0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce1cd8e-b977-4990-9053-9631b187e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Volume 2b2a953d-2cae-495d-9c29-774361bafc6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b2a953d-2cae-495d-9c29-774361bafc6b', 'volume_size': 1, 'image_id': '6d1218b5-133d-4391-ad76-b4b7a956a33c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d1218b5-133d-4391-ad76-b4b7a956a33c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '157ee64b295b28c34d4d197d3ad13943', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2167d91d0e6a4f7e968ed99235c75d8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf4e9531c15e794136944571703f1cd994b3665ff031134423f374cdf1a1f647d995e00bf23e966650813b24381d02c6a1320a2e85f8d7fa4aa6ca1d81d5cf6d', 'id': '6d1218b5-133d-4391-ad76-b4b7a956a33c', 'created_at': datetime.datetime(2026, 11, 2, 9, 12, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 12, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d1218b5-133d-4391-ad76-b4b7a956a33c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Trying to clone 2b2a953d-2cae-495d-9c29-774361bafc6b from image 6d1218b5-133d-4391-ad76-b4b7a956a33c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d1218b5-133d-4391-ad76-b4b7a956a33c', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:12:24 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.296s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Deleted volume successfully. Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:12:24 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7841cb76-f21d-4d25-b65c-60d59ce7017d tempest-VolumeTypesAccessTest-1418301026 None] Lock "cinder-ff381862-70fb-473f-8b9e-4ed95364473b-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[24827b36-61cd-42d8-8afa-a09c7404527b]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:24 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD Nov 02 10:12:24 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:24 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:24 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD Nov 02 10:12:24 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:25 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD" returned: 1 in 0.486s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Temporary image 6d1218b5-133d-4391-ad76-b4b7a956a33c is fetched for user e499aff7eff441f89840d5f127006da1. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f79d887-5c74-49b8-a633-6110d1b4ccde]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:25 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD Nov 02 10:12:25 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Flow 'volume_create_manager' (36a3934a-4557-4006-825a-6aadead42f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf46aaa-3388-4cc6-ba63-3896811f522e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf46aaa-3388-4cc6-ba63-3896811f522e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1149346987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a846910a-fce1-4f01-9e61-2a4eedc769c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184dd11b4fbd42c69ec19e365f5f2822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:25Z,use_quota=True,user_id='668b479135424e22ac8efa44fabd2f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7210f0-35be-47ce-b94f-28a4f6f38214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7210f0-35be-47ce-b94f-28a4f6f38214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3525579-1e1b-43c8-9a35-f67025614413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3525579-1e1b-43c8-9a35-f67025614413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a846910a-fce1-4f01-9e61-2a4eedc769c7', 'volume_name': 'volume-a846910a-fce1-4f01-9e61-2a4eedc769c7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34d52d6-b91d-4862-82ec-ab18e9b631ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34d52d6-b91d-4862-82ec-ab18e9b631ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadd2481-d6f2-4675-a759-2a0ba334df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Volume a846910a-fce1-4f01-9e61-2a4eedc769c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a846910a-fce1-4f01-9e61-2a4eedc769c7', 'volume_size': 1} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1149346987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a846910a-fce1-4f01-9e61-2a4eedc769c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184dd11b4fbd42c69ec19e365f5f2822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:25Z,use_quota=True,user_id='668b479135424e22ac8efa44fabd2f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Creating volume a846910a-fce1-4f01-9e61-2a4eedc769c7 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:25 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:25 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 1073741824 Nov 02 10:12:25 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:25 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:25 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD Nov 02 10:12:25 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:26 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 1073741824" returned: 0 in 0.511s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:26 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:26 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 Nov 02 10:12:26 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:26 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2a953d-2cae-495d-9c29-774361bafc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2167d91d0e6a4f7e968ed99235c75d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:23Z,use_quota=True,user_id='e499aff7eff441f89840d5f127006da1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0c3bcb-ec61-4e2a-b4c1-42f1e3a3a1cf),volume_type_id=3e0c3bcb-ec61-4e2a-b4c1-42f1e3a3a1cf)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Creating volume 2b2a953d-2cae-495d-9c29-774361bafc6b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:26 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadd2481-d6f2-4675-a759-2a0ba334df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a846910a-fce1-4f01-9e61-2a4eedc769c7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e5c5ea-cab2-4073-973e-3de8dc7220bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:26 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b 1073741824 Nov 02 10:12:26 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:26 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Volume volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 (a846910a-fce1-4f01-9e61-2a4eedc769c7): created successfully Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e5c5ea-cab2-4073-973e-3de8dc7220bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Flow 'volume_create_manager' (36a3934a-4557-4006-825a-6aadead42f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-78517324-a22d-4d17-bff4-112c23c2fc6a tempest-VolumesTransfersV357Test-1720361918 None] Created volume successfully. Nov 02 10:12:26 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b 1073741824" returned: 0 in 0.489s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:26 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b Nov 02 10:12:26 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:27 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b" returned: 0 in 0.256s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Attempting download of 6d1218b5-133d-4391-ad76-b4b7a956a33c ((None, [{'url': 'file:///opt/stack/data/glance/images/6d1218b5-133d-4391-ad76-b4b7a956a33c', 'metadata': {}}])) to volume 2b2a953d-2cae-495d-9c29-774361bafc6b. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a354b06-8189-46e8-8478-49383d3a4d50]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d1218b5-133d-4391-ad76-b4b7a956a33c_loqn5y4f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:27 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d1218b5-133d-4391-ad76-b4b7a956a33c_loqn5y4f Nov 02 10:12:27 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:27 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d1218b5-133d-4391-ad76-b4b7a956a33c_loqn5y4f" returned: 0 in 0.413s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1218b5-133d-4391-ad76-b4b7a956a33c_loqn5y4f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:27 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1218b5-133d-4391-ad76-b4b7a956a33c_loqn5y4f Nov 02 10:12:27 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Acquiring lock "cinder-a846910a-fce1-4f01-9e61-2a4eedc769c7-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-a846910a-fce1-4f01-9e61-2a4eedc769c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Acquiring lock "cinder-quobyte-a846910a-fce1-4f01-9e61-2a4eedc769c7" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-quobyte-a846910a-fce1-4f01-9e61-2a4eedc769c7" acquired by "delete_volume" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec3dc6-5b6a-41b9-8403-629f465c99ef]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1218b5-133d-4391-ad76-b4b7a956a33c_loqn5y4f" returned: 1 in 0.399s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1218b5-133d-4391-ad76-b4b7a956a33c_loqn5y4f' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cc7c86-ae63-48c8-a265-371d2604ffbf]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 Nov 02 10:12:28 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD Nov 02 10:12:28 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7" returned: 0 in 0.430s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7 Nov 02 10:12:28 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD Nov 02 10:12:28 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a846910a-fce1-4f01-9e61-2a4eedc769c7" returned: 0 in 0.305s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-quobyte-a846910a-fce1-4f01-9e61-2a4eedc769c7" released by "delete_volume" :: held 0.807s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Created reservations ['e1108446-e765-478d-8195-b9072c1b4fef', 'debdbfd4-c5bf-4895-8b23-274b0a38e23a', '07d18206-e544-4c44-ab4f-fc7179cf9264', '61d1ea5d-173a-407e-8952-d26bdde0489e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:28 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] 6d1218b5-133d-4391-ad76-b4b7a956a33c was raw, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b Nov 02 10:12:28 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:28 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:29 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.360s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:29 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Deleted volume successfully. Nov 02 10:12:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-526c6657-e4b7-442d-9339-8e12890bb50d tempest-VolumesTransfersV357Test-389624059 None] Lock "cinder-a846910a-fce1-4f01-9e61-2a4eedc769c7-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:29 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b" returned: 0 in 0.746s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:29 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d1218b5-133d-4391-ad76-b4b7a956a33c_dzbbxh07devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:12:29 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:12:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:29 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b 1G Nov 02 10:12:29 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:30 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b 1G" returned: 0 in 0.456s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Downloaded image 6d1218b5-133d-4391-ad76-b4b7a956a33c ((None, [{'url': 'file:///opt/stack/data/glance/images/6d1218b5-133d-4391-ad76-b4b7a956a33c', 'metadata': {}}])) to volume 2b2a953d-2cae-495d-9c29-774361bafc6b successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Temporary image 6d1218b5-133d-4391-ad76-b4b7a956a33c for user e499aff7eff441f89840d5f127006da1 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Marking volume 2b2a953d-2cae-495d-9c29-774361bafc6b as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Copying metadata from image 6d1218b5-133d-4391-ad76-b4b7a956a33c to 2b2a953d-2cae-495d-9c29-774361bafc6b. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Creating volume glance metadata for volume 2b2a953d-2cae-495d-9c29-774361bafc6b backed by image 6d1218b5-133d-4391-ad76-b4b7a956a33c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6d1218b5-133d-4391-ad76-b4b7a956a33c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '157ee64b295b28c34d4d197d3ad13943', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce1cd8e-b977-4990-9053-9631b187e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2a953d-2cae-495d-9c29-774361bafc6b', 'volume_size': 1, 'image_id': '6d1218b5-133d-4391-ad76-b4b7a956a33c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d1218b5-133d-4391-ad76-b4b7a956a33c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '157ee64b295b28c34d4d197d3ad13943', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2167d91d0e6a4f7e968ed99235c75d8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf4e9531c15e794136944571703f1cd994b3665ff031134423f374cdf1a1f647d995e00bf23e966650813b24381d02c6a1320a2e85f8d7fa4aa6ca1d81d5cf6d', 'id': '6d1218b5-133d-4391-ad76-b4b7a956a33c', 'created_at': datetime.datetime(2026, 11, 2, 9, 12, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 12, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d1218b5-133d-4391-ad76-b4b7a956a33c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eab12ce-da65-4e2a-af2b-5893072a6399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:30 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Volume volume-2b2a953d-2cae-495d-9c29-774361bafc6b (2b2a953d-2cae-495d-9c29-774361bafc6b): created successfully Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eab12ce-da65-4e2a-af2b-5893072a6399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Flow 'volume_create_manager' (f95194fc-d807-4908-92e8-dd91694b9f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7d5aaa9e-d718-49e0-aad3-bbb9fa742138 tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Created volume successfully. Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Acquiring lock "cinder-2b2a953d-2cae-495d-9c29-774361bafc6b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "cinder-2b2a953d-2cae-495d-9c29-774361bafc6b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Acquiring lock "cinder-quobyte-2b2a953d-2cae-495d-9c29-774361bafc6b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "cinder-quobyte-2b2a953d-2cae-495d-9c29-774361bafc6b" acquired by "delete_volume" :: waited 0.043s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acd0af2-81d8-455f-a285-1de107e54d07]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:31 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b Nov 02 10:12:31 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:31 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b" returned: 0 in 0.625s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:31 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b Nov 02 10:12:31 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:32 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2b2a953d-2cae-495d-9c29-774361bafc6b" returned: 0 in 0.434s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "cinder-quobyte-2b2a953d-2cae-495d-9c29-774361bafc6b" released by "delete_volume" :: held 1.149s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:32 devstack cinder-volume[87005]: WARNING cinder.quota [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:32 devstack cinder-volume[87005]: WARNING cinder.quota [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Created reservations ['456f2da7-b764-465d-b465-87f4d03f3af5', '6cccb0ce-7e53-46ac-b94f-9287003c0e6c', '7a5a70ff-99a1-4fc6-8ce3-d4384c00bded', '192ca4c1-98b3-41b8-9df4-9a201c7f9a8d'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:32 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:32 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:33 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:33 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Deleted volume successfully. Nov 02 10:12:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5520c9f8-c45f-43bb-8d45-aff20470599f tempest-VolumeAndVolumeTypeFromImageTest-1301435051 None] Lock "cinder-2b2a953d-2cae-495d-9c29-774361bafc6b-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:35 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Flow 'volume_create_manager' (40eb255f-0c11-4ca3-aaae-13d9c791af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8a80bd-3732-4060-a9b4-f4dd939c0f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8a80bd-3732-4060-a9b4-f4dd939c0f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1525560220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5380b1c-d2b7-4fa5-bc83-ef6e76084439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60906dda3714c5583195e8486e7f829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:36Z,use_quota=True,user_id='6190b83455a342b0b2b1076649b8e2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cc2bdb-7452-4269-8575-23f8d9e5d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cc2bdb-7452-4269-8575-23f8d9e5d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5eaaf1-9b1d-4d05-a00e-521c89ecedf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5eaaf1-9b1d-4d05-a00e-521c89ecedf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5380b1c-d2b7-4fa5-bc83-ef6e76084439', 'volume_name': 'volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f65667-f0d5-4c88-9084-f6739fcf2713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f65667-f0d5-4c88-9084-f6739fcf2713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3790d2-f761-4da1-aee4-768528aef4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Volume e5380b1c-d2b7-4fa5-bc83-ef6e76084439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439', 'volume_size': 1} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1525560220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5380b1c-d2b7-4fa5-bc83-ef6e76084439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60906dda3714c5583195e8486e7f829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:36Z,use_quota=True,user_id='6190b83455a342b0b2b1076649b8e2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Creating volume e5380b1c-d2b7-4fa5-bc83-ef6e76084439 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:36 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:36 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 1073741824 Nov 02 10:12:36 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:36 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 1073741824" returned: 0 in 0.559s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:36 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 Nov 02 10:12:36 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:36 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439" returned: 0 in 0.288s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3790d2-f761-4da1-aee4-768528aef4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d80fe8-51a3-41fe-8c16-80666f3a6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Volume volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 (e5380b1c-d2b7-4fa5-bc83-ef6e76084439): created successfully Nov 02 10:12:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d80fe8-51a3-41fe-8c16-80666f3a6597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Flow 'volume_create_manager' (40eb255f-0c11-4ca3-aaae-13d9c791af0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:37 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3f309712-78ee-4099-ba1b-9b7dfb9cd44e tempest-VolumesListAdminTestJSON-1415408408 None] Created volume successfully. Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Flow 'volume_create_manager' (d870f627-d4ff-434c-b094-3de9c9f9ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e7aede-e928-498d-a673-239792cfe612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e7aede-e928-498d-a673-239792cfe612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1778272264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2ee804-9b13-4904-a32b-9a73688b35a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2286a9b10ec8406ba1456104c7aed10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:38Z,use_quota=True,user_id='61b1a2e4c0d746b4810027350d8888cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49fa369-43d2-4cdc-872f-7998a33097f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49fa369-43d2-4cdc-872f-7998a33097f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcca1df-9806-462c-8dfa-755ad0c19e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcca1df-9806-462c-8dfa-755ad0c19e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad2ee804-9b13-4904-a32b-9a73688b35a0', 'volume_name': 'volume-ad2ee804-9b13-4904-a32b-9a73688b35a0', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbd7f0c-9a1a-4a94-a2f6-eee2cf820a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbd7f0c-9a1a-4a94-a2f6-eee2cf820a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a8a47d-72a4-42c9-a0a6-e63e7720027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Volume ad2ee804-9b13-4904-a32b-9a73688b35a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad2ee804-9b13-4904-a32b-9a73688b35a0', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Trying to clone ad2ee804-9b13-4904-a32b-9a73688b35a0 from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Flow 'volume_create_manager' (f9fe6d90-67e7-4da1-859e-89bfb36208d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f43c47b-c780-4b90-a352-c081250f311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f43c47b-c780-4b90-a352-c081250f311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959656213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193e3584-54cf-48b5-a438-26a5d54ad31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60906dda3714c5583195e8486e7f829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:39Z,use_quota=True,user_id='6190b83455a342b0b2b1076649b8e2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3479b747-569c-4727-9cb2-06c8353ab7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3479b747-569c-4727-9cb2-06c8353ab7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403a0703-c2e8-4b18-9295-711b131fdcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403a0703-c2e8-4b18-9295-711b131fdcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193e3584-54cf-48b5-a438-26a5d54ad31c', 'volume_name': 'volume-193e3584-54cf-48b5-a438-26a5d54ad31c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8049b40-7e8f-4d6f-a72d-ee347abd4b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8049b40-7e8f-4d6f-a72d-ee347abd4b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ca5b50-ee3f-4969-9e6f-470a707078db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Volume 193e3584-54cf-48b5-a438-26a5d54ad31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193e3584-54cf-48b5-a438-26a5d54ad31c', 'volume_size': 1} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959656213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193e3584-54cf-48b5-a438-26a5d54ad31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60906dda3714c5583195e8486e7f829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:39Z,use_quota=True,user_id='6190b83455a342b0b2b1076649b8e2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Creating volume 193e3584-54cf-48b5-a438-26a5d54ad31c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:38 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:38 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c 1073741824 Nov 02 10:12:38 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:38 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:12:38 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9555dd-528c-4ea8-a026-3bcdb19b1f24]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:39 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD Nov 02 10:12:39 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:39 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c 1073741824" returned: 0 in 0.573s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=101,cinder:SELECT=82,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:39 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c Nov 02 10:12:39 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=101,cinder:UPDATE=103,cinder:INSERT=38,cinder:DELETE=7 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:39 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (8419a4f2-64c1-43f2-b6d3-7229868a9124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c142bd-1d80-4d9a-8c23-df60b526d84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 is fetched for user 61b1a2e4c0d746b4810027350d8888cc. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c142bd-1d80-4d9a-8c23-df60b526d84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1537801223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6712a6-5eb8-41e3-8e15-9ff73ed99a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:39Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35f3fe3-035c-4ef8-ba50-f3a1c1f38af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35f3fe3-035c-4ef8-ba50-f3a1c1f38af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f385c5-5de6-4fc0-a7cd-47f20ab2aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f385c5-5de6-4fc0-a7cd-47f20ab2aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6712a6-5eb8-41e3-8e15-9ff73ed99a87', 'volume_name': 'volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90c8f75-343f-4732-a5c6-63a5edf9c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90c8f75-343f-4732-a5c6-63a5edf9c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99476da0-d90a-465d-8e95-a6dbb8d2c2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:39 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume cd6712a6-5eb8-41e3-8e15-9ff73ed99a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87', 'volume_size': 1} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f9dbf-b9e3-4835-8e51-3e1a91f8646f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:39 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c" returned: 0 in 0.269s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.091s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1537801223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6712a6-5eb8-41e3-8e15-9ff73ed99a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:39Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Creating volume cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:39 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:39 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 1073741824 Nov 02 10:12:39 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ca5b50-ee3f-4969-9e6f-470a707078db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193e3584-54cf-48b5-a438-26a5d54ad31c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bef0e5-7136-4ae9-815d-67ba06bf208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:39 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Volume volume-193e3584-54cf-48b5-a438-26a5d54ad31c (193e3584-54cf-48b5-a438-26a5d54ad31c): created successfully Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bef0e5-7136-4ae9-815d-67ba06bf208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Flow 'volume_create_manager' (f9fe6d90-67e7-4da1-859e-89bfb36208d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:39 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD Nov 02 10:12:39 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-189e1f43-4704-4583-9068-f97e5ff89b1f tempest-VolumesListAdminTestJSON-1415408408 None] Created volume successfully. Nov 02 10:12:39 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:40 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 1073741824" returned: 0 in 0.411s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:40 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 Nov 02 10:12:40 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:40 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" returned: 0 in 0.243s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1778272264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2ee804-9b13-4904-a32b-9a73688b35a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2286a9b10ec8406ba1456104c7aed10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:38Z,use_quota=True,user_id='61b1a2e4c0d746b4810027350d8888cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Creating volume ad2ee804-9b13-4904-a32b-9a73688b35a0 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:40 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99476da0-d90a-465d-8e95-a6dbb8d2c2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:40 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 1073741824 Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8472dc4e-1835-432f-b6b8-1e8f1751d3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:40 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:40 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 (cd6712a6-5eb8-41e3-8e15-9ff73ed99a87): created successfully Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8472dc4e-1835-432f-b6b8-1e8f1751d3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (8419a4f2-64c1-43f2-b6d3-7229868a9124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:40 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-07a71b8d-7507-40f3-b51e-f70c49ee555a tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created volume successfully. Nov 02 10:12:40 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 1073741824" returned: 0 in 0.442s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:40 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 Nov 02 10:12:40 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:41 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0" returned: 0 in 0.309s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Attempting download of 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume ad2ee804-9b13-4904-a32b-9a73688b35a0. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[52651add-4390-4f52-a3c9-1bb4fc78d587]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_t2guzg6b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Flow 'volume_create_manager' (779a0ac9-62da-4219-a849-65a64ad60c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd39690-d2d4-48ec-9051-55bac734d9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd39690-d2d4-48ec-9051-55bac734d9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1250860662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60906dda3714c5583195e8486e7f829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:41Z,use_quota=True,user_id='6190b83455a342b0b2b1076649b8e2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c85561d-928b-4d92-a5ff-9d477bfb7720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c85561d-928b-4d92-a5ff-9d477bfb7720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9874556c-299b-4d67-a525-def7dda02880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:41 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_t2guzg6b Nov 02 10:12:41 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9874556c-299b-4d67-a525-def7dda02880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f', 'volume_name': 'volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b59210-f87b-48a4-b114-3c6501a3b3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b59210-f87b-48a4-b114-3c6501a3b3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db8d244-9727-4377-a603-68663bcee01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:41 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Volume 38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f', 'volume_size': 1} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1250860662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60906dda3714c5583195e8486e7f829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:41Z,use_quota=True,user_id='6190b83455a342b0b2b1076649b8e2ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Creating volume 38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:41 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:41 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f 1073741824 Nov 02 10:12:41 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:41 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_t2guzg6b" returned: 0 in 0.414s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_t2guzg6b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:41 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_t2guzg6b Nov 02 10:12:41 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:41 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f 1073741824" returned: 0 in 0.532s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:41 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f Nov 02 10:12:41 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:42 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_t2guzg6b" returned: 1 in 0.353s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_t2guzg6b' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b7f6e-16d0-4ced-96a8-1317c054cef5]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:42 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD Nov 02 10:12:42 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:42 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f" returned: 0 in 0.292s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.509s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db8d244-9727-4377-a603-68663bcee01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98075434-d734-4154-a4d5-2a3dbf8c5d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Creating offline snapshot babcece7-eaa2-4fa0-bcac-caa04477c250 of volume cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:12:42 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Volume volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f (38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f): created successfully Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98075434-d734-4154-a4d5-2a3dbf8c5d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Flow 'volume_create_manager' (779a0ac9-62da-4219-a849-65a64ad60c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a3a7a3-8c99-43a7-91e5-0decb00c1655]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:42 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4f111eea-b1cf-43b6-8c42-872a802fdd59 tempest-VolumesListAdminTestJSON-1415408408 None] Created volume successfully. Nov 02 10:12:42 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] 4e759a38-67b9-4ba7-b77d-917ff16305f2 was qcow2, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:42 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 Nov 02 10:12:42 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:42 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 Nov 02 10:12:42 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:42 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:42 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 1G Nov 02 10:12:42 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:43 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 1G" returned: 0 in 0.476s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:43 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 Nov 02 10:12:43 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:43 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250" returned: 0 in 0.353s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:43 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 is being set with open permissions: ugo+rw Nov 02 10:12:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:43 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 Nov 02 10:12:43 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:43 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250" returned: 0 in 0.339s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:43 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.info Nov 02 10:12:43 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:44 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.info" returned: 0 in 0.352s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:44 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.info is being set with open permissions: ugo+rw Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:44 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.info Nov 02 10:12:44 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Flow 'volume_create_manager' (8b6b3b6f-2af3-4a12-8a18-d233e095a84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512b87e-37c2-4a60-839f-287cc1bd4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512b87e-37c2-4a60-839f-287cc1bd4db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecec7f73-5d13-4348-bb77-cd6a66d1d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0111a045999748c8880e1b11f0796528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:44Z,use_quota=True,user_id='c77a42396e4a44fabd5143c74f5d6aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b288600-86a9-49fd-befa-613268f368a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b288600-86a9-49fd-befa-613268f368a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f591f0-5318-4a8e-a21c-c58c0910eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f591f0-5318-4a8e-a21c-c58c0910eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecec7f73-5d13-4348-bb77-cd6a66d1d228', 'volume_name': 'volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe8a084-da7a-4b6b-8bed-c9165fd0e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe8a084-da7a-4b6b-8bed-c9165fd0e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107b3076-e7cc-49de-acc6-3eef0eab019e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Volume ecec7f73-5d13-4348-bb77-cd6a66d1d228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228', 'volume_size': 1} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:44 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.info" returned: 0 in 0.329s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:44 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecec7f73-5d13-4348-bb77-cd6a66d1d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0111a045999748c8880e1b11f0796528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:44Z,use_quota=True,user_id='c77a42396e4a44fabd5143c74f5d6aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Creating volume ecec7f73-5d13-4348-bb77-cd6a66d1d228 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:44 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0" returned: 0 in 2.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2_1q6wlekadevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:12:44 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Converted 112.00 MB image at 49.21 MB/s Nov 02 10:12:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:44 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 1073741824 Nov 02 10:12:44 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:44 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5cdc4388-74f1-4b06-a4ed-7d69033c7a2d tempest-CreateVolumesFromSnapshotTest-1714698883 None] Create snapshot completed successfully Nov 02 10:12:44 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 1G Nov 02 10:12:44 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:45 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 1G" returned: 0 in 0.452s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Downloaded image 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume ad2ee804-9b13-4904-a32b-9a73688b35a0 successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 for user 61b1a2e4c0d746b4810027350d8888cc is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Marking volume ad2ee804-9b13-4904-a32b-9a73688b35a0 as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Copying metadata from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 to ad2ee804-9b13-4904-a32b-9a73688b35a0. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Creating volume glance metadata for volume ad2ee804-9b13-4904-a32b-9a73688b35a0 backed by image 4e759a38-67b9-4ba7-b77d-917ff16305f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a8a47d-72a4-42c9-a0a6-e63e7720027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2ee804-9b13-4904-a32b-9a73688b35a0', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57937a10-e88a-457b-9a13-e30c4baaa466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:45 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 1073741824" returned: 0 in 0.685s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Volume volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 (ad2ee804-9b13-4904-a32b-9a73688b35a0): created successfully Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57937a10-e88a-457b-9a13-e30c4baaa466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Flow 'volume_create_manager' (d870f627-d4ff-434c-b094-3de9c9f9ee35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c91a1122-fda1-4318-a80d-fa7b2f1978e9 tempest-VolumesExtendTest-203335992 None] Created volume successfully. Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:45 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 Nov 02 10:12:45 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (4b298e41-b169-41ce-a72d-7efbe79a38d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af6430a-fa25-4aef-85e4-1d9af825dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af6430a-fa25-4aef-85e4-1d9af825dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2100792158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db3b840-34d7-42c6-bde9-e708ce9899fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:46Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05dc00-7ff8-4dfd-a038-982f4eae4034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:45 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05dc00-7ff8-4dfd-a038-982f4eae4034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567b4bfa-d877-41a9-92de-7c67737d6201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567b4bfa-d877-41a9-92de-7c67737d6201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db3b840-34d7-42c6-bde9-e708ce9899fd', 'volume_name': 'volume-7db3b840-34d7-42c6-bde9-e708ce9899fd', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c8c8a-5130-4e8a-9c59-a99984cce0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c8c8a-5130-4e8a-9c59-a99984cce0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf09da7d-e54c-4bc8-99f8-4065e654c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume 7db3b840-34d7-42c6-bde9-e708ce9899fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db3b840-34d7-42c6-bde9-e708ce9899fd', 'volume_size': 1} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228" returned: 0 in 0.461s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2100792158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db3b840-34d7-42c6-bde9-e708ce9899fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:46Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Creating volume 7db3b840-34d7-42c6-bde9-e708ce9899fd {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:45 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107b3076-e7cc-49de-acc6-3eef0eab019e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:45 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd 1073741824 Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88738ed0-de75-4292-838c-38f27ecafd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:45 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:45 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Volume volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 (ecec7f73-5d13-4348-bb77-cd6a66d1d228): created successfully Nov 02 10:12:45 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88738ed0-de75-4292-838c-38f27ecafd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Flow 'volume_create_manager' (8b6b3b6f-2af3-4a12-8a18-d233e095a84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-341ba130-e6f8-4944-b203-2c0fe989fc63 tempest-VolumesListAdminTestJSON-1369008854 None] Created volume successfully. Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (b98300fd-5214-41c5-9c56-340a649e7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ee7b4c-76e0-4751-9e7b-c00a31ebeb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Acquiring lock "cinder-ecec7f73-5d13-4348-bb77-cd6a66d1d228-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ee7b4c-76e0-4751-9e7b-c00a31ebeb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788771838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88168ce-498a-47a0-8f9d-203ae864847b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:47Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad4c88d-8101-47a0-94e0-08c02d4c0fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad4c88d-8101-47a0-94e0-08c02d4c0fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a105cc9-07c0-45f6-b4f6-1e1de103d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a105cc9-07c0-45f6-b4f6-1e1de103d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88168ce-498a-47a0-8f9d-203ae864847b', 'volume_name': 'volume-b88168ce-498a-47a0-8f9d-203ae864847b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7ed402-b3cf-4e4f-b3fe-62ce743bbe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7ed402-b3cf-4e4f-b3fe-62ce743bbe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576eaff3-13f9-4168-a6ce-b464321ac2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume b88168ce-498a-47a0-8f9d-203ae864847b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88168ce-498a-47a0-8f9d-203ae864847b', 'volume_size': 1} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:46 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd 1073741824" returned: 0 in 1.005s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Lock "cinder-ecec7f73-5d13-4348-bb77-cd6a66d1d228-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Acquiring lock "cinder-quobyte-ecec7f73-5d13-4348-bb77-cd6a66d1d228" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:47 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd Nov 02 10:12:47 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Lock "cinder-quobyte-ecec7f73-5d13-4348-bb77-cd6a66d1d228" acquired by "delete_volume" :: waited 0.043s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded4ca77-7379-4e84-834a-3cb048e3d46b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:47 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:47 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 Nov 02 10:12:47 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "cinder-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd" returned: 0 in 0.493s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.583s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf09da7d-e54c-4bc8-99f8-4065e654c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db3b840-34d7-42c6-bde9-e708ce9899fd', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f51e9-7547-45e4-a085-0e4dee1b25a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[91976aac-7815-4c7c-a1e6-57c5fe2f0e39]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (10cd9541-f11a-4b41-88f9-e4ae6fe4501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44fe631-2340-498b-929b-d66cca65fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44fe631-2340-498b-929b-d66cca65fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203834930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a938401-94ba-4df4-817b-ce64fb3d9cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:47Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a3dd04-4073-4217-9e40-0e99fa73b999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a3dd04-4073-4217-9e40-0e99fa73b999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd24a25a-ee2a-4333-a7bf-ed40a7c8f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd24a25a-ee2a-4333-a7bf-ed40a7c8f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a938401-94ba-4df4-817b-ce64fb3d9cfa', 'volume_name': 'volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:47 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 Nov 02 10:12:47 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24095ee-e304-44f0-a0ad-3f0682bb69ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24095ee-e304-44f0-a0ad-3f0682bb69ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a343f1-3bc2-418a-a8e7-0928d674ecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:48 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume 7a938401-94ba-4df4-817b-ce64fb3d9cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa', 'volume_size': 1} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:48 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume volume-7db3b840-34d7-42c6-bde9-e708ce9899fd (7db3b840-34d7-42c6-bde9-e708ce9899fd): created successfully Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f51e9-7547-45e4-a085-0e4dee1b25a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (4b298e41-b169-41ce-a72d-7efbe79a38d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0f4aad28-b679-417f-9cd7-57a6ecc55761 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created volume successfully. Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "cinder-quobyte-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-quobyte-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5756f906-0705-462e-a5e1-e454486d3cb2]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:48 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228" returned: 0 in 0.991s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:48 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228 Nov 02 10:12:48 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:48 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f Nov 02 10:12:48 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:48 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0" returned: 0 in 0.672s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 2G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (241e7afb-d387-4981-80f6-dcf424729361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac4e0ee-200b-4fbe-ac2a-bc3ac9b2fe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac4e0ee-200b-4fbe-ac2a-bc3ac9b2fe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208744486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:48Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890a99c3-558a-49e6-83ea-5b2b30ef3f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890a99c3-558a-49e6-83ea-5b2b30ef3f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3a11bb-6dac-44ff-a527-e9720c1893a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3a11bb-6dac-44ff-a527-e9720c1893a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da', 'volume_name': 'volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d997da3b-ec01-42ba-a2f3-28d174de5479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d997da3b-ec01-42ba-a2f3-28d174de5479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c3aa38-b4c9-47ec-8dd3-1ee1c364c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:48 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da', 'volume_size': 1} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 2G" returned: 0 in 0.304s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.135s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.814s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788771838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88168ce-498a-47a0-8f9d-203ae864847b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:47Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Creating volume b88168ce-498a-47a0-8f9d-203ae864847b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:48 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:48 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b 1073741824 Nov 02 10:12:48 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:48 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ecec7f73-5d13-4348-bb77-cd6a66d1d228" returned: 0 in 0.692s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:48 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:48 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:48 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f" returned: 0 in 0.825s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Lock "cinder-quobyte-ecec7f73-5d13-4348-bb77-cd6a66d1d228" released by "delete_volume" :: held 1.854s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cf47f0df-210c-4212-8d15-53e53676b015 tempest-VolumesExtendTest-203335992 None] Extend volume completed successfully. Nov 02 10:12:49 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f Nov 02 10:12:49 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Created reservations ['5f73e6c8-f465-4d90-a5f6-8de1208799f2', '216fb490-6188-4966-b75f-1bc82424aa2b', 'f7b6e79d-7be1-46d9-b4e2-d85846e6b568', 'c8a686a7-3377-4b5e-9cb3-8a9dd75a0460'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:49 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.655s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:12:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-fc710fa2-5989-48b3-baa2-621a996a5ed1 tempest-TestShelveInstance-1403493392 None] Terminate volume connection completed successfully. Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-fc710fa2-5989-48b3-baa2-621a996a5ed1 tempest-TestShelveInstance-1403493392 None] Deleting attachment b52e87f6-ef3d-4158-80ec-365489508df3. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:12:49 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:49 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (f5e3ab8a-db84-4942-8b15-3418edbf6c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e394ce-983f-49d3-b684-0a58183452e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:49 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e394ce-983f-49d3-b684-0a58183452e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008560784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5ebc83-bc7f-430f-a2c8-2818e8ea6518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:49Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d66bad-f30f-49ad-814a-17ce699ecf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d66bad-f30f-49ad-814a-17ce699ecf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d8dc27-631b-40a9-bea1-78a93fd2fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d8dc27-631b-40a9-bea1-78a93fd2fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5ebc83-bc7f-430f-a2c8-2818e8ea6518', 'volume_name': 'volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8f6af8-459f-4f08-b8d6-3f198cdaf88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8f6af8-459f-4f08-b8d6-3f198cdaf88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29453d6-4c87-4485-87cb-6a9713cf0ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:49 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume bc5ebc83-bc7f-430f-a2c8-2818e8ea6518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518', 'volume_size': 1} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f" returned: 0 in 0.721s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-quobyte-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f" released by "delete_volume" :: held 1.601s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:49 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b 1073741824" returned: 0 in 1.045s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Acquiring lock "cinder-82fb4426-a502-471e-80f5-06dc7947230c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Created reservations ['c8a100bf-9c33-4682-8cc0-9013b27a58b9', '6ab30c35-47b5-455f-a74c-c4e94066b720', '70aef113-071c-4aeb-aca7-dcdf09ec4c14', 'ee097f99-ee56-4164-a82e-21c47bf5f471'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Lock "cinder-82fb4426-a502-471e-80f5-06dc7947230c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:49 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b Nov 02 10:12:49 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Acquiring lock "cinder-quobyte-82fb4426-a502-471e-80f5-06dc7947230c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:50 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Acquiring lock "cinder-ad2ee804-9b13-4904-a32b-9a73688b35a0-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.591s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:50 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:50 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Lock "cinder-quobyte-82fb4426-a502-471e-80f5-06dc7947230c" acquired by "delete_volume" :: waited 0.166s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Deleted volume successfully. Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[735d58f0-707e-4656-9a6a-4bafa978c534]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Lock "cinder-ad2ee804-9b13-4904-a32b-9a73688b35a0-delete_volume" acquired by "delete_volume" :: waited 0.211s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ccd27442-f5e3-4cdd-8694-91e2ffb6f20a tempest-VolumesListAdminTestJSON-1369008854 None] Lock "cinder-ecec7f73-5d13-4348-bb77-cd6a66d1d228-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:50 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b" returned: 0 in 0.525s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.458s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203834930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a938401-94ba-4df4-817b-ce64fb3d9cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:47Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Creating volume 7a938401-94ba-4df4-817b-ce64fb3d9cfa {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:50 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:50 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa 1073741824 Nov 02 10:12:50 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "cinder-193e3584-54cf-48b5-a438-26a5d54ad31c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Acquiring lock "cinder-quobyte-ad2ee804-9b13-4904-a32b-9a73688b35a0" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576eaff3-13f9-4168-a6ce-b464321ac2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88168ce-498a-47a0-8f9d-203ae864847b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:50 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c Nov 02 10:12:50 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89f0521-8017-4524-87ac-60f0ab2d8800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:50 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.625s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-193e3584-54cf-48b5-a438-26a5d54ad31c-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Deleted volume successfully. Nov 02 10:12:50 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume volume-b88168ce-498a-47a0-8f9d-203ae864847b (b88168ce-498a-47a0-8f9d-203ae864847b): created successfully Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89f0521-8017-4524-87ac-60f0ab2d8800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (b98300fd-5214-41c5-9c56-340a649e7b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-ad2ee804-9b13-4904-a32b-9a73688b35a0" acquired by "delete_volume" :: waited 0.128s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da9d41-f131-46ce-914d-9d0377149ee2]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c7f9a915-bc53-41e2-8d26-f2ff5310a1e5 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created volume successfully. Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2c75ae5a-569c-4ef7-b620-5a29490cca3a tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-38eda2e0-3a4e-4b66-9ea9-9bfc5ac9816f-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "cinder-quobyte-193e3584-54cf-48b5-a438-26a5d54ad31c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-quobyte-193e3584-54cf-48b5-a438-26a5d54ad31c" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df192a8-f1cc-4c54-a4c1-2c492ae29362]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:50 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 Nov 02 10:12:50 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:50 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c" returned: 0 in 0.700s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c Nov 02 10:12:51 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c Nov 02 10:12:51 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa 1073741824" returned: 0 in 0.698s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0" returned: 0 in 0.479s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0 Nov 02 10:12:51 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa Nov 02 10:12:51 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c" returned: 0 in 0.487s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c Nov 02 10:12:51 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-82fb4426-a502-471e-80f5-06dc7947230c" returned: 0 in 0.436s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Lock "cinder-quobyte-82fb4426-a502-471e-80f5-06dc7947230c" released by "delete_volume" :: held 1.288s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.quota [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Created reservations ['37720556-9fef-4151-8bb0-d6d3dae5ed54', 'ea8ef449-09d6-4681-a2e1-af10d1b6319d', '8a06ecd2-78f4-46ce-8861-094eb9e8abcb', 'c01cd765-750a-40ed-9727-7fdacb45b133'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:51 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa" returned: 0 in 0.322s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208744486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:48Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Creating volume b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:51 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:51 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad2ee804-9b13-4904-a32b-9a73688b35a0" returned: 0 in 0.404s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da 1073741824 Nov 02 10:12:51 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a343f1-3bc2-418a-a8e7-0928d674ecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f54da3-7f22-4600-86c3-3d3e734bfbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-ad2ee804-9b13-4904-a32b-9a73688b35a0" released by "delete_volume" :: held 0.982s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa (7a938401-94ba-4df4-817b-ce64fb3d9cfa): created successfully Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f54da3-7f22-4600-86c3-3d3e734bfbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (10cd9541-f11a-4b41-88f9-e4ae6fe4501c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:51 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:51 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-aceb3d18-3668-4de5-864a-8e5ddf2e4381 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created volume successfully. Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Created reservations ['b7b2db75-c0dd-4b30-9f94-4fc3ef84f12b', '0dad1c5d-1e7b-4666-ae73-bdf904ff067f', '293153fa-0228-4103-b1c2-161fcd4fa3cb', 'a537e5f2-6877-479a-ae18-529c9dac12ca'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:51 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-193e3584-54cf-48b5-a438-26a5d54ad31c" returned: 0 in 0.478s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-quobyte-193e3584-54cf-48b5-a438-26a5d54ad31c" released by "delete_volume" :: held 1.036s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:51 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Created reservations ['4724db63-8654-4a01-bcbd-b204b9d4fca7', 'de0bb2ff-530e-4469-8a04-e4d1a76c6dbd', '389c2969-c2a3-4613-ac6e-1b7fe7639d24', '5d9f7c97-8595-462b-b31f-c7d49448d823'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:52 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.355s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.manager [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Deleted volume successfully. Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [req-20ef3881-7b20-4dbd-99ac-5f7a7d22aa1b req-b111b739-828c-4b55-adf5-3cf7d62d93f7 tempest-TestShelveInstance-1403493392 None] Lock "cinder-82fb4426-a502-471e-80f5-06dc7947230c-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:52 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:52 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:52 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.418s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Deleted volume successfully. Nov 02 10:12:52 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e524855d-c0fa-416a-ab2f-9ff6c7f80fec tempest-VolumesExtendTest-203335992 None] Lock "cinder-ad2ee804-9b13-4904-a32b-9a73688b35a0-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da 1073741824" returned: 0 in 0.793s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:52 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da Nov 02 10:12:52 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:52 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.365s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Deleted volume successfully. Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ebae504b-afcd-45f8-9cc3-8e55d09305be tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-193e3584-54cf-48b5-a438-26a5d54ad31c-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:52 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da" returned: 0 in 0.325s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.091s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008560784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5ebc83-bc7f-430f-a2c8-2818e8ea6518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf9d203a0504aa0b0081258c8e6740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:49Z,use_quota=True,user_id='2e33c65486a049b7bb23775947c90ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Creating volume bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:52 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:52 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 1073741824 Nov 02 10:12:52 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c3aa38-b4c9-47ec-8dd3-1ee1c364c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c132fd1-0f40-4378-9d62-1659c653cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:52 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da (b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da): created successfully Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c132fd1-0f40-4378-9d62-1659c653cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (241e7afb-d387-4981-80f6-dcf424729361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-20052521-3d18-4b2f-84d6-4d31dd4512b9 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created volume successfully. Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "cinder-e5380b1c-d2b7-4fa5-bc83-ef6e76084439-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-e5380b1c-d2b7-4fa5-bc83-ef6e76084439-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "cinder-quobyte-e5380b1c-d2b7-4fa5-bc83-ef6e76084439" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-quobyte-e5380b1c-d2b7-4fa5-bc83-ef6e76084439" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c95213-c89c-434a-82cb-9715308ebf60]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Flow 'volume_create_manager' (3e8ca71c-22e7-4fd9-8758-4d7514bc9e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1613d810-69e8-4d09-a893-82956ea94f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1613d810-69e8-4d09-a893-82956ea94f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-217091383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0efc580-a499-4c00-9284-7b8bf358c8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2286a9b10ec8406ba1456104c7aed10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:53Z,use_quota=True,user_id='61b1a2e4c0d746b4810027350d8888cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d07cc-ae8e-46d1-acd5-fba503805400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d07cc-ae8e-46d1-acd5-fba503805400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4323a4-9d92-4ded-93ec-ba7bcf8627c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4323a4-9d92-4ded-93ec-ba7bcf8627c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0efc580-a499-4c00-9284-7b8bf358c8b0', 'volume_name': 'volume-f0efc580-a499-4c00-9284-7b8bf358c8b0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188989de-ab7c-4b23-b4e2-afba8b62bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:53 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 Nov 02 10:12:53 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188989de-ab7c-4b23-b4e2-afba8b62bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bc6a45-c6cf-4649-bd04-f6e7728e3720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:53 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Volume f0efc580-a499-4c00-9284-7b8bf358c8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0efc580-a499-4c00-9284-7b8bf358c8b0', 'volume_size': 1} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:53 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 1073741824" returned: 0 in 0.600s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:53 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 Nov 02 10:12:53 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:53 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439" returned: 0 in 0.521s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:53 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439 Nov 02 10:12:53 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:53 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518" returned: 0 in 0.360s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-217091383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0efc580-a499-4c00-9284-7b8bf358c8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2286a9b10ec8406ba1456104c7aed10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:53Z,use_quota=True,user_id='61b1a2e4c0d746b4810027350d8888cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Creating volume f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:53 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29453d6-4c87-4485-87cb-6a9713cf0ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:53 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 1073741824 Nov 02 10:12:53 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d887bf-7f86-4edd-8649-1def5f45d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:53 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Volume volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 (bc5ebc83-bc7f-430f-a2c8-2818e8ea6518): created successfully Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d887bf-7f86-4edd-8649-1def5f45d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Flow 'volume_create_manager' (f5e3ab8a-db84-4942-8b15-3418edbf6c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-29b11237-0c13-4086-a702-c6f5d874520b tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created volume successfully. Nov 02 10:12:54 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5380b1c-d2b7-4fa5-bc83-ef6e76084439" returned: 0 in 0.511s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-quobyte-e5380b1c-d2b7-4fa5-bc83-ef6e76084439" released by "delete_volume" :: held 1.100s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Created reservations ['5c4f6c3f-7cef-4274-be3f-c451569deacd', '75992339-0629-4b9f-a546-1e3d6ae2f5ba', '614aa7df-d684-4401-866f-fdffa3c66abf', '23fffaf9-9a07-463e-a553-4716b964024d'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518" acquired by "delete_volume" :: waited 0.041s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:54 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bda7b4-18d4-49bf-8671-54f57905c820]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 1073741824" returned: 0 in 0.867s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:54 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:54 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:54 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 Nov 02 10:12:54 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 Nov 02 10:12:54 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:54 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:55 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.419s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Deleted volume successfully. Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f94aa33e-6f69-4c4e-bd94-5b88b0c787b3 tempest-VolumesListAdminTestJSON-1415408408 None] Lock "cinder-e5380b1c-d2b7-4fa5-bc83-ef6e76084439-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:55 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0" returned: 0 in 0.410s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:55 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bc6a45-c6cf-4649-bd04-f6e7728e3720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0efc580-a499-4c00-9284-7b8bf358c8b0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66992cb7-3f90-4eda-a6f4-889ca5ee5a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518" returned: 0 in 0.540s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:55 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518 Nov 02 10:12:55 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:55 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Volume volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 (f0efc580-a499-4c00-9284-7b8bf358c8b0): created successfully Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66992cb7-3f90-4eda-a6f4-889ca5ee5a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Flow 'volume_create_manager' (3e8ca71c-22e7-4fd9-8758-4d7514bc9e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0380a65b-155b-4461-8f5f-f41f845418a3 tempest-VolumesExtendTest-203335992 None] Created volume successfully. Nov 02 10:12:55 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518" returned: 0 in 0.362s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518" released by "delete_volume" :: held 0.988s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created reservations ['9da8521b-1cb7-434e-a250-9e185fba25ff', '7c2821a8-543d-490f-8301-b0d62218a4ed', 'f06d5c6a-fb2e-421c-845c-d0df54565df8', 'cf3a204e-afe0-4d9e-b922-678823c1ae27'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:55 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:55 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:56 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.291s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:56 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Deleted volume successfully. Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-dedff827-895a-4e8d-b593-0e10add0322e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-bc5ebc83-bc7f-430f-a2c8-2818e8ea6518-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Creating offline snapshot 78e8fd1e-e13c-4412-bdda-78e666c7b97c of volume f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[13505403-1940-4271-9107-ab0e0b945ef8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:56 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 Nov 02 10:12:56 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da" acquired by "delete_volume" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a6b97-1a34-43a1-833a-202542fe1720]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:57 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da Nov 02 10:12:57 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:57 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0" returned: 0 in 0.513s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:57 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c 1G Nov 02 10:12:57 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:57 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da" returned: 0 in 0.668s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:57 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da Nov 02 10:12:57 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:57 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c 1G" returned: 0 in 0.724s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:58 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c Nov 02 10:12:58 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:58 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da" released by "delete_volume" :: held 1.137s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created reservations ['5402ecf5-f8b0-4b11-b8ee-dcace7122187', 'bbb1c2bd-0f57-4d53-b45c-5597ef9e9eba', '4bb40fc4-b5f2-40ab-934e-703aca2860be', 'fd23fd5a-4dfa-49a5-bb9d-5e85621923dd'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:58 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:12:58 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:58 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c" returned: 0 in 0.449s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:58 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c is being set with open permissions: ugo+rw Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:58 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c Nov 02 10:12:58 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:58 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.355s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:58 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Deleted volume successfully. Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b4466803-c87a-4468-8a0f-7b3b90983f9e tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-b24d4b0d-fa8e-4dd2-95b7-d6d5cfb2b2da-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:58 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c" returned: 0 in 0.399s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:58 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.info Nov 02 10:12:58 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-7a938401-94ba-4df4-817b-ce64fb3d9cfa-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-7a938401-94ba-4df4-817b-ce64fb3d9cfa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:59 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.info" returned: 0 in 0.436s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:59 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.info is being set with open permissions: ugo+rw Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:59 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.info Nov 02 10:12:59 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-7a938401-94ba-4df4-817b-ce64fb3d9cfa" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-7a938401-94ba-4df4-817b-ce64fb3d9cfa" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd4538d-de16-478f-b8fa-355043695cfb]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:59 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa Nov 02 10:12:59 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:59 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.info" returned: 0 in 0.347s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.996s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:59 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-bb8a130e-9228-4d7a-8cc1-557af610a481 tempest-VolumesExtendTest-203335992 None] Create snapshot completed successfully Nov 02 10:13:00 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa" returned: 0 in 0.582s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:00 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa Nov 02 10:13:00 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e726fe0-b604-4dd5-926d-da75876c0856]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:00 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 Nov 02 10:13:00 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:00 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7a938401-94ba-4df4-817b-ce64fb3d9cfa" returned: 0 in 0.417s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-7a938401-94ba-4df4-817b-ce64fb3d9cfa" released by "delete_volume" :: held 1.090s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created reservations ['24fb37e5-38f5-466c-87ad-651c37ed6316', 'f7b546aa-ac18-4ebf-bb77-ad4d90e86491', 'ae9658da-4aab-4f7b-b4cd-d330385e3049', 'ffea0358-9d96-4e4d-b2ef-288952a81091'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:00 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:00 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:00 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0" returned: 0 in 0.583s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c 2G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c 2G" returned: 0 in 0.180s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.823s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-edc444a2-5ab6-4779-9372-a750064bcb6d tempest-VolumesExtendTest-203335992 None] Extend volume completed successfully. Nov 02 10:13:01 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.371s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Deleted volume successfully. Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cfe6c0ce-aeaf-46b0-af3d-65fdb28b4239 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-7a938401-94ba-4df4-817b-ce64fb3d9cfa-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Acquiring lock "cinder-78e8fd1e-e13c-4412-bdda-78e666c7b97c-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Lock "cinder-78e8fd1e-e13c-4412-bdda-78e666c7b97c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Acquiring lock "cinder-quobyte-f0efc580-a499-4c00-9284-7b8bf358c8b0" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-f0efc580-a499-4c00-9284-7b8bf358c8b0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Acquiring lock "cinder-quobyte-78e8fd1e-e13c-4412-bdda-78e666c7b97c" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-78e8fd1e-e13c-4412-bdda-78e666c7b97c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Deleting offline snapshot 78e8fd1e-e13c-4412-bdda-78e666c7b97c of volume f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] snapshot_file for this snap is: volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-b88168ce-498a-47a0-8f9d-203ae864847b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-b88168ce-498a-47a0-8f9d-203ae864847b-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e570c50-47ce-4c69-a0d5-377e3c9238b8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-b88168ce-498a-47a0-8f9d-203ae864847b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-b88168ce-498a-47a0-8f9d-203ae864847b" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8fac7-c74f-4ebc-8b24-b5ee1da1dea0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:01 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c Nov 02 10:13:01 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:02 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b Nov 02 10:13:02 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:02 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c" returned: 0 in 0.502s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0efc580-a499-4c00-9284-7b8bf358c8b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[18243439-cbd1-4f9e-969e-a7559849c9fc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:02 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b" returned: 0 in 0.535s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:02 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 Nov 02 10:13:02 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:02 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b Nov 02 10:13:02 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:02 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b88168ce-498a-47a0-8f9d-203ae864847b" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-b88168ce-498a-47a0-8f9d-203ae864847b" released by "delete_volume" :: held 0.986s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:02 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0" returned: 0 in 0.561s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:02 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c Nov 02 10:13:02 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:02 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created reservations ['7bedd92e-dffc-4a77-aec1-336d5985baa9', '5985ceea-e844-409b-9267-5284c89b3acb', '6e6221b1-2823-466e-8e2a-a19566fe5ab7', '810defaf-3e38-48b8-aed7-cbf48cfdb431'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:03 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:03 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:03 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c" returned: 0 in 0.604s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:03 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.427s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Deleted volume successfully. Nov 02 10:13:03 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c Nov 02 10:13:03 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5409c138-b953-4569-8cb8-4c08e3bdb732 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-b88168ce-498a-47a0-8f9d-203ae864847b-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:03 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0.78e8fd1e-e13c-4412-bdda-78e666c7b97c" returned: 0 in 0.349s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-78e8fd1e-e13c-4412-bdda-78e666c7b97c" released by "_delete_snapshot" :: held 2.284s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-f0efc580-a499-4c00-9284-7b8bf358c8b0" released by "delete_snapshot" :: held 2.329s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-7db3b840-34d7-42c6-bde9-e708ce9899fd-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Created reservations ['6de2ac49-f788-405b-9e40-e7c1d44c5a02', '6cb18ff5-f474-454d-88c2-f808f5567a9f', 'e5ebdeb6-dcd4-4452-92b0-43b7f785fcff', 'b66ddf77-941a-4b05-99e3-bfaa89facf4f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-7db3b840-34d7-42c6-bde9-e708ce9899fd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-7db3b840-34d7-42c6-bde9-e708ce9899fd" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-7db3b840-34d7-42c6-bde9-e708ce9899fd" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:04 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Delete snapshot completed successfully. Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-21553d15-a035-4cb1-bf54-16cd304f5ccf tempest-VolumesExtendTest-203335992 None] Lock "cinder-78e8fd1e-e13c-4412-bdda-78e666c7b97c-delete_snapshot" released by "delete_snapshot" :: held 2.625s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f91e932-17b3-457a-b8b3-471a9e8925b4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:04 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd Nov 02 10:13:04 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:04 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd" returned: 0 in 0.441s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:04 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd Nov 02 10:13:04 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Acquiring lock "cinder-f0efc580-a499-4c00-9284-7b8bf358c8b0-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Lock "cinder-f0efc580-a499-4c00-9284-7b8bf358c8b0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Acquiring lock "cinder-quobyte-f0efc580-a499-4c00-9284-7b8bf358c8b0" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-f0efc580-a499-4c00-9284-7b8bf358c8b0" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:05 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7db3b840-34d7-42c6-bde9-e708ce9899fd" returned: 0 in 0.523s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-7db3b840-34d7-42c6-bde9-e708ce9899fd" released by "delete_volume" :: held 1.029s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b4787-2ddc-495e-8663-4a5550370f87]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created reservations ['ebd98043-6d15-4263-8ed4-5a34ba3d3a66', 'a5df5f00-4560-4cd5-81ba-24b40644ae3d', 'ad7025cb-fda9-4961-b24d-dee9424636b1', '8838daf8-239e-4daf-b74e-bfbd55e09231'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:05 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 Nov 02 10:13:05 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:05 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:05 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:05 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.344s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Deleted volume successfully. Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-171aaa71-7e76-4c48-902c-d522810cec26 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-7db3b840-34d7-42c6-bde9-e708ce9899fd-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:05 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0" returned: 0 in 0.570s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:05 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0 Nov 02 10:13:05 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:06 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f0efc580-a499-4c00-9284-7b8bf358c8b0" returned: 0 in 0.327s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Lock "cinder-quobyte-f0efc580-a499-4c00-9284-7b8bf358c8b0" released by "delete_volume" :: held 1.039s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Created reservations ['2f9834e8-b013-473f-8d1a-8a7eb0db5e64', '0db9c6ab-3c5c-45e6-b8fb-0e5427c1001a', '9fe565fd-666b-4f5c-ab50-21dfc8bc1209', 'af84ec99-8ecd-4848-b607-f927f5036a3a'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-babcece7-eaa2-4fa0-bcac-caa04477c250-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:06 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:06 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-babcece7-eaa2-4fa0-bcac-caa04477c250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-babcece7-eaa2-4fa0-bcac-caa04477c250" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-babcece7-eaa2-4fa0-bcac-caa04477c250" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Deleting offline snapshot babcece7-eaa2-4fa0-bcac-caa04477c250 of volume cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] snapshot_file for this snap is: volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa31dbd-0067-413a-9c8a-938d6df03f86]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:06 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.357s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Deleted volume successfully. Nov 02 10:13:06 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 Nov 02 10:13:06 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-09f61f15-0010-4be3-9423-a14fd8a9fe69 tempest-VolumesExtendTest-203335992 None] Lock "cinder-f0efc580-a499-4c00-9284-7b8bf358c8b0-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:06 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250" returned: 0 in 0.468s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:13:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a9dc9-5d3f-48a0-aa1a-bc1a104bb96e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:07 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 Nov 02 10:13:07 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:07 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" returned: 0 in 0.550s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:07 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 Nov 02 10:13:07 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:08 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250" returned: 0 in 0.484s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:08 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250 Nov 02 10:13:08 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:08 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87.babcece7-eaa2-4fa0-bcac-caa04477c250" returned: 0 in 0.306s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-babcece7-eaa2-4fa0-bcac-caa04477c250" released by "_delete_snapshot" :: held 2.045s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" released by "delete_snapshot" :: held 2.085s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:08 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created reservations ['a393af96-067f-4ef0-952a-ead89b4ae3bd', '0bf15f1e-b948-4e4b-aeab-1beed77962eb', '7e6186dd-2d4c-4f1b-a2b4-7b613d953264', '4ecaa6b9-dc40-4cbd-8323-27c6c1c9fd0d'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Delete snapshot completed successfully. Nov 02 10:13:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f0790ca7-f35a-4c23-a222-f0c4ef1e1a86 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-babcece7-eaa2-4fa0-bcac-caa04477c250-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "cinder-quobyte-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:09 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c753c4d2-25c8-4ab4-9e94-04c5fd9cff47]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:10 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 Nov 02 10:13:10 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:10 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" returned: 0 in 0.469s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:10 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87 Nov 02 10:13:10 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:10 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" returned: 0 in 0.423s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-quobyte-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87" released by "delete_volume" :: held 0.996s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:10 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Flow 'volume_create_manager' (9a191677-afa1-4a7d-9310-5b7917f352dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135e07f-63b8-470b-9052-3dafcc413cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135e07f-63b8-470b-9052-3dafcc413cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1584043361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ed5da9-eeb7-4dbe-8899-cf847dc14bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac5c71107d494b9af0dff005d5c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:11Z,use_quota=True,user_id='eeea0976a0cc43a9a84b7a0193f9364a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7ad845-7de0-4d4b-a185-2d10941f16da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7ad845-7de0-4d4b-a185-2d10941f16da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d3bdfa-7b95-4b59-9c13-a7424ce5dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d3bdfa-7b95-4b59-9c13-a7424ce5dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ed5da9-eeb7-4dbe-8899-cf847dc14bae', 'volume_name': 'volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541f2b54-bd33-42da-b7f7-7b1bd92b38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541f2b54-bd33-42da-b7f7-7b1bd92b38fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31eead7-5729-4b03-a1a3-2aa3953bada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Volume 20ed5da9-eeb7-4dbe-8899-cf847dc14bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae', 'volume_size': 1} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1584043361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ed5da9-eeb7-4dbe-8899-cf847dc14bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac5c71107d494b9af0dff005d5c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:11Z,use_quota=True,user_id='eeea0976a0cc43a9a84b7a0193f9364a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Creating volume 20ed5da9-eeb7-4dbe-8899-cf847dc14bae {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:11 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:11 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae 1073741824 Nov 02 10:13:11 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Created reservations ['27884e4f-d0df-4233-a19e-4fc8b82ac865', '17df8223-bdc3-4913-afb6-ef8ad26b5724', '87d953d4-4b6e-4957-80dd-8dc263155197', 'ae34939a-b9e4-4125-86c4-704901f3bfd2'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:11 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:11 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:11 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.339s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Deleted volume successfully. Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0718e81a-0116-4778-8aed-523c4a328722 tempest-CreateVolumesFromSnapshotTest-1714698883 None] Lock "cinder-cd6712a6-5eb8-41e3-8e15-9ff73ed99a87-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:11 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae 1073741824" returned: 0 in 0.618s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:11 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae Nov 02 10:13:11 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:12 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae" returned: 0 in 0.367s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31eead7-5729-4b03-a1a3-2aa3953bada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0056c1d2-cea7-44f9-bb40-2b2187b1ad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:12 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Volume volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae (20ed5da9-eeb7-4dbe-8899-cf847dc14bae): created successfully Nov 02 10:13:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0056c1d2-cea7-44f9-bb40-2b2187b1ad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Flow 'volume_create_manager' (9a191677-afa1-4a7d-9310-5b7917f352dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2528cba9-c98d-46ef-bc07-603501e2f312 tempest-AbsoluteLimitsTests-1253117704 None] Created volume successfully. Nov 02 10:13:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Acquiring lock "cinder-20ed5da9-eeb7-4dbe-8899-cf847dc14bae-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Lock "cinder-20ed5da9-eeb7-4dbe-8899-cf847dc14bae-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Acquiring lock "cinder-quobyte-20ed5da9-eeb7-4dbe-8899-cf847dc14bae" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Lock "cinder-quobyte-20ed5da9-eeb7-4dbe-8899-cf847dc14bae" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:13 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea74101-1278-433b-96f9-fac3ae20be63]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:13 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae Nov 02 10:13:13 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:14 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae" returned: 0 in 0.634s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:14 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae Nov 02 10:13:14 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:14 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-20ed5da9-eeb7-4dbe-8899-cf847dc14bae" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Lock "cinder-quobyte-20ed5da9-eeb7-4dbe-8899-cf847dc14bae" released by "delete_volume" :: held 1.091s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:14 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Created reservations ['30735a5b-e7a8-421b-a486-3db9d3f165f4', '628a2d6f-7161-44fa-af50-78ba5e4e2917', '64b0bd9d-0869-4ab5-8b0c-97fb254970d7', '595694e2-d876-4038-883c-110bd73e3870'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:15 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:15 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:15 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.443s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Deleted volume successfully. Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5dc3a523-c291-437b-a4fe-e49939d0b81b tempest-AbsoluteLimitsTests-1253117704 None] Lock "cinder-20ed5da9-eeb7-4dbe-8899-cf847dc14bae-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Flow 'volume_create_manager' (a8dc4279-9243-45bd-b347-6fedf5ec6c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bc0b02-8d1d-4a6b-9821-36d5d97d2ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bc0b02-8d1d-4a6b-9821-36d5d97d2ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69517927-2492-45d3-98de-0dc839c35249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0350d09240453f960375de33fc2914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:16Z,use_quota=True,user_id='c5366aaa9828496fa178588f5ecbf595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d86ab23-46e2-415c-bb69-78c2bb55fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d86ab23-46e2-415c-bb69-78c2bb55fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c89cb6b-607e-4380-b9be-275ff5f9d74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:15 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c89cb6b-607e-4380-b9be-275ff5f9d74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69517927-2492-45d3-98de-0dc839c35249', 'volume_name': 'volume-69517927-2492-45d3-98de-0dc839c35249', 'volume_size': 1, 'image_id': 'df0be2c9-832e-4876-a957-2fbcd624eee5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df0be2c9-832e-4876-a957-2fbcd624eee5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb59da6a09a131e8f832b91e48bfc446', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e0350d09240453f960375de33fc2914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '870295f977541e4bb91452ebae4acade1fbf8270f5fa29d437586b0ab18dce729faa27ea33610da095c50bf0f71477a79fa89d25e3a870c07104d8e9f5ff6315', 'id': 'df0be2c9-832e-4876-a957-2fbcd624eee5', 'created_at': datetime.datetime(2026, 11, 2, 9, 13, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 13, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df0be2c9-832e-4876-a957-2fbcd624eee5/file', 'properties': {}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccff80e-7286-42a1-980d-e0be3889458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccff80e-7286-42a1-980d-e0be3889458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99bc81d-0995-476f-8623-b4c978a77d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:16 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Volume 69517927-2492-45d3-98de-0dc839c35249: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69517927-2492-45d3-98de-0dc839c35249', 'volume_size': 1, 'image_id': 'df0be2c9-832e-4876-a957-2fbcd624eee5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df0be2c9-832e-4876-a957-2fbcd624eee5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb59da6a09a131e8f832b91e48bfc446', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e0350d09240453f960375de33fc2914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '870295f977541e4bb91452ebae4acade1fbf8270f5fa29d437586b0ab18dce729faa27ea33610da095c50bf0f71477a79fa89d25e3a870c07104d8e9f5ff6315', 'id': 'df0be2c9-832e-4876-a957-2fbcd624eee5', 'created_at': datetime.datetime(2026, 11, 2, 9, 13, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 13, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df0be2c9-832e-4876-a957-2fbcd624eee5/file', 'properties': {}}, 'image_service': } Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Trying to clone 69517927-2492-45d3-98de-0dc839c35249 from image df0be2c9-832e-4876-a957-2fbcd624eee5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df0be2c9-832e-4876-a957-2fbcd624eee5', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:13:16 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5582b1-7e5c-4593-bbba-050aa4158a92]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:16 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD Nov 02 10:13:16 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:17 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:17 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD Nov 02 10:13:17 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:17 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD" returned: 1 in 0.428s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:13:17 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Temporary image df0be2c9-832e-4876-a957-2fbcd624eee5 is fetched for user c5366aaa9828496fa178588f5ecbf595. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:13:17 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd71d8-bf05-497e-9d23-4c8cb4e3dcce]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:17 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD Nov 02 10:13:17 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:18 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:18 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD Nov 02 10:13:18 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (c5e5eca8-95ac-4db5-832b-b98f48f03723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2963ea4c-9cae-43d8-99ff-e31789d59d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2963ea4c-9cae-43d8-99ff-e31789d59d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830618626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b1528a-15b0-476d-938c-f952152afb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:18Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd236121-bf9b-477a-b89b-9c25ca3674ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd236121-bf9b-477a-b89b-9c25ca3674ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8253a19-e326-4310-a061-a58abd995691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8253a19-e326-4310-a061-a58abd995691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b1528a-15b0-476d-938c-f952152afb5d', 'volume_name': 'volume-04b1528a-15b0-476d-938c-f952152afb5d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313408f9-36de-46f8-8ff0-e4021d9a639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313408f9-36de-46f8-8ff0-e4021d9a639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c434b04-74b1-488c-8996-15498719d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:18 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Volume 04b1528a-15b0-476d-938c-f952152afb5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b1528a-15b0-476d-938c-f952152afb5d', 'volume_size': 1} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830618626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b1528a-15b0-476d-938c-f952152afb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:18Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Creating volume 04b1528a-15b0-476d-938c-f952152afb5d {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:18 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:18 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d 1073741824 Nov 02 10:13:18 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:18 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD" returned: 1 in 0.607s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:13:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:19 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d 1073741824" returned: 0 in 0.679s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:19 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d Nov 02 10:13:19 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:19 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d" returned: 0 in 0.298s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69517927-2492-45d3-98de-0dc839c35249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0350d09240453f960375de33fc2914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:16Z,use_quota=True,user_id='c5366aaa9828496fa178588f5ecbf595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Creating volume 69517927-2492-45d3-98de-0dc839c35249 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:19 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:19 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 1073741824 Nov 02 10:13:19 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c434b04-74b1-488c-8996-15498719d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b1528a-15b0-476d-938c-f952152afb5d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6a1ca3-ae78-46ac-a7b4-ccfd3d0260f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Volume volume-04b1528a-15b0-476d-938c-f952152afb5d (04b1528a-15b0-476d-938c-f952152afb5d): created successfully Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6a1ca3-ae78-46ac-a7b4-ccfd3d0260f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (c5e5eca8-95ac-4db5-832b-b98f48f03723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-1f8470a1-0692-4c82-b824-56bac1f39457 tempest-ProjectReaderTests-1555065208 None] Created volume successfully. Nov 02 10:13:20 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 1073741824" returned: 0 in 0.618s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:20 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 Nov 02 10:13:20 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:20 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249" returned: 0 in 0.350s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Attempting download of df0be2c9-832e-4876-a957-2fbcd624eee5 ((None, [{'url': 'file:///opt/stack/data/glance/images/df0be2c9-832e-4876-a957-2fbcd624eee5', 'metadata': {}}])) to volume 69517927-2492-45d3-98de-0dc839c35249. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[beab38ca-2347-493b-bd72-1c5d7ee286ff]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df0be2c9-832e-4876-a957-2fbcd624eee5_qmh946sf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-04b1528a-15b0-476d-938c-f952152afb5d-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-04b1528a-15b0-476d-938c-f952152afb5d-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:21 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df0be2c9-832e-4876-a957-2fbcd624eee5_qmh946sf Nov 02 10:13:21 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-quobyte-04b1528a-15b0-476d-938c-f952152afb5d" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-04b1528a-15b0-476d-938c-f952152afb5d" acquired by "delete_volume" :: waited 0.038s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d67daeb-bd74-4d0f-9e95-d67a2bd2402a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:21 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d Nov 02 10:13:21 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:21 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df0be2c9-832e-4876-a957-2fbcd624eee5_qmh946sf" returned: 0 in 0.513s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df0be2c9-832e-4876-a957-2fbcd624eee5_qmh946sf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:21 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df0be2c9-832e-4876-a957-2fbcd624eee5_qmh946sf Nov 02 10:13:21 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:21 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df0be2c9-832e-4876-a957-2fbcd624eee5_qmh946sf" returned: 1 in 0.431s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df0be2c9-832e-4876-a957-2fbcd624eee5_qmh946sf' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b2ca8-3812-4ddd-abfd-c4c42583bdf3]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:21 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d" returned: 0 in 0.618s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:21 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d Nov 02 10:13:21 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:21 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD Nov 02 10:13:21 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:22 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-04b1528a-15b0-476d-938c-f952152afb5d" returned: 0 in 0.355s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-04b1528a-15b0-476d-938c-f952152afb5d" released by "delete_volume" :: held 1.047s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:22 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Created reservations ['430bab95-00eb-4efd-a6c3-4e1a05f91d0d', '338ddf4c-d203-4a79-9dcb-e188356268e3', '95320454-1ac1-452a-84cc-55eb54a59b39', '13221b16-4ea4-40af-b595-fcecef5f48cd'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:22 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD Nov 02 10:13:22 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:22 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:22 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:22 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD" returned: 1 in 0.444s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] df0be2c9-832e-4876-a957-2fbcd624eee5 was raw, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:22 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.353s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:22 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 Nov 02 10:13:22 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Deleted volume successfully. Nov 02 10:13:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a0649a0-70a2-40c9-81a3-1432a0aae521 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-04b1528a-15b0-476d-938c-f952152afb5d-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:23 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249" returned: 0 in 0.650s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df0be2c9-832e-4876-a957-2fbcd624eee5_u3q3ijy1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:13:23 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:23 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 1G Nov 02 10:13:23 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:23 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 1G" returned: 0 in 0.584s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Downloaded image df0be2c9-832e-4876-a957-2fbcd624eee5 ((None, [{'url': 'file:///opt/stack/data/glance/images/df0be2c9-832e-4876-a957-2fbcd624eee5', 'metadata': {}}])) to volume 69517927-2492-45d3-98de-0dc839c35249 successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Temporary image df0be2c9-832e-4876-a957-2fbcd624eee5 for user c5366aaa9828496fa178588f5ecbf595 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Marking volume 69517927-2492-45d3-98de-0dc839c35249 as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Copying metadata from image df0be2c9-832e-4876-a957-2fbcd624eee5 to 69517927-2492-45d3-98de-0dc839c35249. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:13:23 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Creating volume glance metadata for volume 69517927-2492-45d3-98de-0dc839c35249 backed by image df0be2c9-832e-4876-a957-2fbcd624eee5 with: {'image_id': 'df0be2c9-832e-4876-a957-2fbcd624eee5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fb59da6a09a131e8f832b91e48bfc446', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (1c1d35b3-09fa-47d3-908d-caceec2334a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6d0401-da4b-4b6a-9429-1299b4a9513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6d0401-da4b-4b6a-9429-1299b4a9513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582263795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab155f59-b460-4217-8d00-344ef556f41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:24Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7bab8e-9a71-4ebe-9f24-ac4f7033f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7bab8e-9a71-4ebe-9f24-ac4f7033f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7cfb78-204d-4fca-a315-218c1f3c7fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7cfb78-204d-4fca-a315-218c1f3c7fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab155f59-b460-4217-8d00-344ef556f41b', 'volume_name': 'volume-ab155f59-b460-4217-8d00-344ef556f41b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c763231c-f608-4755-b49a-dae50e552faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c763231c-f608-4755-b49a-dae50e552faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996f3ef0-dd47-4d63-b53c-8da9be2f18a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Volume ab155f59-b460-4217-8d00-344ef556f41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab155f59-b460-4217-8d00-344ef556f41b', 'volume_size': 1} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582263795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab155f59-b460-4217-8d00-344ef556f41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:24Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Creating volume ab155f59-b460-4217-8d00-344ef556f41b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:24 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:24 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b 1073741824 Nov 02 10:13:24 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99bc81d-0995-476f-8623-b4c978a77d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69517927-2492-45d3-98de-0dc839c35249', 'volume_size': 1, 'image_id': 'df0be2c9-832e-4876-a957-2fbcd624eee5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df0be2c9-832e-4876-a957-2fbcd624eee5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb59da6a09a131e8f832b91e48bfc446', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e0350d09240453f960375de33fc2914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '870295f977541e4bb91452ebae4acade1fbf8270f5fa29d437586b0ab18dce729faa27ea33610da095c50bf0f71477a79fa89d25e3a870c07104d8e9f5ff6315', 'id': 'df0be2c9-832e-4876-a957-2fbcd624eee5', 'created_at': datetime.datetime(2026, 11, 2, 9, 13, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 13, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df0be2c9-832e-4876-a957-2fbcd624eee5/file', 'properties': {}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557e75ee-98df-45db-b8cf-2aaa709abdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Volume volume-69517927-2492-45d3-98de-0dc839c35249 (69517927-2492-45d3-98de-0dc839c35249): created successfully Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557e75ee-98df-45db-b8cf-2aaa709abdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Flow 'volume_create_manager' (a8dc4279-9243-45bd-b347-6fedf5ec6c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-50521e6d-846b-49df-8669-351af74e03ac tempest-VolumeImageDependencyTests-765430740 None] Created volume successfully. Nov 02 10:13:24 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b 1073741824" returned: 0 in 0.677s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:24 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b Nov 02 10:13:24 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:25 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b" returned: 0 in 0.301s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996f3ef0-dd47-4d63-b53c-8da9be2f18a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab155f59-b460-4217-8d00-344ef556f41b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc928d6-ce8f-4878-899c-ee1ff15516dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Volume volume-ab155f59-b460-4217-8d00-344ef556f41b (ab155f59-b460-4217-8d00-344ef556f41b): created successfully Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc928d6-ce8f-4878-899c-ee1ff15516dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (1c1d35b3-09fa-47d3-908d-caceec2334a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ae5ca982-73a1-4bea-bc7d-64da62fdeed4 tempest-ProjectReaderTests-1555065208 None] Created volume successfully. Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Acquiring lock "cinder-69517927-2492-45d3-98de-0dc839c35249-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Lock "cinder-69517927-2492-45d3-98de-0dc839c35249-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:25 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Flow 'volume_create_manager' (907fed06-e8f5-4b43-bf1a-9300b75e0ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4493bd9-99cd-49eb-b75b-d968926590f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Acquiring lock "cinder-quobyte-69517927-2492-45d3-98de-0dc839c35249" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4493bd9-99cd-49eb-b75b-d968926590f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1579623837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e9a97e-ebb8-4a89-bffa-f52741fd3efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a717f3571242d4b846334f4a1589ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:26Z,use_quota=True,user_id='20ca3e28416e46f5b13821eceb061032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940f06e7-c36e-4cfd-88ed-2a852d18ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940f06e7-c36e-4cfd-88ed-2a852d18ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bca7e4-7976-438c-8017-fe710b15e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bca7e4-7976-438c-8017-fe710b15e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e9a97e-ebb8-4a89-bffa-f52741fd3efc', 'volume_name': 'volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c7be40-a161-4bee-963e-01a8ecc3b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c7be40-a161-4bee-963e-01a8ecc3b59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0050b9ec-875d-4ea2-9f57-c2231237ae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:26 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Volume b9e9a97e-ebb8-4a89-bffa-f52741fd3efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc', 'volume_size': 1} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1579623837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e9a97e-ebb8-4a89-bffa-f52741fd3efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a717f3571242d4b846334f4a1589ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:26Z,use_quota=True,user_id='20ca3e28416e46f5b13821eceb061032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Creating volume b9e9a97e-ebb8-4a89-bffa-f52741fd3efc {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:26 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-ab155f59-b460-4217-8d00-344ef556f41b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Lock "cinder-quobyte-69517927-2492-45d3-98de-0dc839c35249" acquired by "delete_volume" :: waited 0.185s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:26 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc 1073741824 Nov 02 10:13:26 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-ab155f59-b460-4217-8d00-344ef556f41b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e36adf-8eaf-4619-8ba8-8cd7d82734b4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-quobyte-ab155f59-b460-4217-8d00-344ef556f41b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-ab155f59-b460-4217-8d00-344ef556f41b" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b7c73-59d1-499e-a872-e23331c22498]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:26 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 Nov 02 10:13:26 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:26 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b Nov 02 10:13:26 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:26 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc 1073741824" returned: 0 in 0.623s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:26 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249" returned: 0 in 0.527s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:26 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249 Nov 02 10:13:26 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:26 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b" returned: 0 in 0.494s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:26 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc Nov 02 10:13:26 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:26 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b Nov 02 10:13:26 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:27 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-69517927-2492-45d3-98de-0dc839c35249" returned: 0 in 0.342s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Lock "cinder-quobyte-69517927-2492-45d3-98de-0dc839c35249" released by "delete_volume" :: held 0.954s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:27 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc" returned: 0 in 0.364s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0050b9ec-875d-4ea2-9f57-c2231237ae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:27 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1295f60-3496-4c2c-ab29-e8c40f87460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ab155f59-b460-4217-8d00-344ef556f41b" returned: 0 in 0.383s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-ab155f59-b460-4217-8d00-344ef556f41b" released by "delete_volume" :: held 0.937s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:27 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Volume volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc (b9e9a97e-ebb8-4a89-bffa-f52741fd3efc): created successfully Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1295f60-3496-4c2c-ab29-e8c40f87460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Flow 'volume_create_manager' (907fed06-e8f5-4b43-bf1a-9300b75e0ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Created reservations ['81a3cc5b-8d8f-4136-b919-4249e60aeb67', '3df8a3d6-c704-4bca-9422-507d0e713972', 'ce2f9752-d3b9-45d0-ab1d-426e88506e32', '08a16f82-f947-4fed-9a94-8b2f81d8c071'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6b646501-87dc-4cfa-98cf-879c999abfb6 tempest-VolumesTransfersV355Test-1481924930 None] Created volume successfully. Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Created reservations ['90df3e2a-bd9a-49f4-875a-7bf14cdcb7d4', '49d88932-043f-4e9f-99bd-3edf3ea2ce1c', 'b2a5617c-b3f1-41f5-aa16-eb3b63f7bf74', 'e40ffd0e-5c63-418d-9048-783e181d6460'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:27 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:27 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:27 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:27 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (88c49c43-8bcf-4838-a8d5-e884bc211a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfa411-1951-4813-9a6c-afac5065daa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfa411-1951-4813-9a6c-afac5065daa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-516488504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18ee036-e538-42e5-8e7b-52f6cfc86299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:27Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc38284d-9673-40ea-919e-1b26bee7d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc38284d-9673-40ea-919e-1b26bee7d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f076405-7c26-45b8-b299-f2ccf4c37832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f076405-7c26-45b8-b299-f2ccf4c37832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a18ee036-e538-42e5-8e7b-52f6cfc86299', 'volume_name': 'volume-a18ee036-e538-42e5-8e7b-52f6cfc86299', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6601e52e-161b-44a2-b279-8f68db0e169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6601e52e-161b-44a2-b279-8f68db0e169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c1c4a2-aae6-40ac-ac43-87fe449286cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:27 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Volume a18ee036-e538-42e5-8e7b-52f6cfc86299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a18ee036-e538-42e5-8e7b-52f6cfc86299', 'volume_size': 1} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-516488504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18ee036-e538-42e5-8e7b-52f6cfc86299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:27Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Creating volume a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:27 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:27 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 1073741824 Nov 02 10:13:27 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:27 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.271s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Deleted volume successfully. Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-49ccbfb5-2454-44c2-9e60-c91e4d131ac8 tempest-VolumeImageDependencyTests-765430740 None] Lock "cinder-69517927-2492-45d3-98de-0dc839c35249-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:27 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Deleted volume successfully. Nov 02 10:13:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e7ee77f0-8919-440e-88fc-230063c19a39 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-ab155f59-b460-4217-8d00-344ef556f41b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:28 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 1073741824" returned: 0 in 0.559s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:28 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 Nov 02 10:13:28 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:28 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299" returned: 0 in 0.317s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c1c4a2-aae6-40ac-ac43-87fe449286cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18ee036-e538-42e5-8e7b-52f6cfc86299', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5e149f-a9d0-481f-bdb5-bc9ff8374678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:28 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Volume volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 (a18ee036-e538-42e5-8e7b-52f6cfc86299): created successfully Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5e149f-a9d0-481f-bdb5-bc9ff8374678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (88c49c43-8bcf-4838-a8d5-e884bc211a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-440d5cc7-3db4-45cd-9124-62d2363b5adb tempest-VolumesSnapshotTestJSON-118013990 None] Created volume successfully. Nov 02 10:13:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8584bf78-c522-471e-9b6c-2d1951681a0c tempest-VolumesTransfersV355Test-182870586 None] Transfer volume completed successfully. Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (d33141ac-cb9e-45d4-8f0e-804a0d6db67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0173196a-8bdc-4b41-a645-b99e8ca8b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0173196a-8bdc-4b41-a645-b99e8ca8b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570951231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be78956f-1fc7-42e3-8d37-56f8a9989736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:29Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b6761e-ceea-44e1-97b9-3234f9b61bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b6761e-ceea-44e1-97b9-3234f9b61bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdf2fb4-56b0-4806-9883-b770427b7f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdf2fb4-56b0-4806-9883-b770427b7f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be78956f-1fc7-42e3-8d37-56f8a9989736', 'volume_name': 'volume-be78956f-1fc7-42e3-8d37-56f8a9989736', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cae220a-234e-449f-b525-356f0ef303fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cae220a-234e-449f-b525-356f0ef303fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35e17aa-bc4d-469f-9258-d69292fb0332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Volume be78956f-1fc7-42e3-8d37-56f8a9989736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be78956f-1fc7-42e3-8d37-56f8a9989736', 'volume_size': 1} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570951231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be78956f-1fc7-42e3-8d37-56f8a9989736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:29Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Creating volume be78956f-1fc7-42e3-8d37-56f8a9989736 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:29 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:29 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 1073741824 Nov 02 10:13:29 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Acquiring lock "cinder-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Acquiring lock "cinder-quobyte-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:29 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 1073741824" returned: 0 in 0.717s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-quobyte-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82357cc-c38c-46fe-8b68-7bb1dc974253]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:30 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 Nov 02 10:13:30 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:30 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc Nov 02 10:13:30 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:30 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736" returned: 0 in 0.358s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.071s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Creating offline snapshot 870d400d-af20-4bd3-88bf-dd711e96bea0 of volume a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35e17aa-bc4d-469f-9258-d69292fb0332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be78956f-1fc7-42e3-8d37-56f8a9989736', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544f1996-5948-4381-a3a7-854729e3610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aab59b-e313-420e-b960-5a45c2566144]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:30 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Volume volume-be78956f-1fc7-42e3-8d37-56f8a9989736 (be78956f-1fc7-42e3-8d37-56f8a9989736): created successfully Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544f1996-5948-4381-a3a7-854729e3610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (d33141ac-cb9e-45d4-8f0e-804a0d6db67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e1b46727-a782-416c-847a-5fa284873541 tempest-ProjectReaderTests-1555065208 None] Created volume successfully. Nov 02 10:13:30 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc" returned: 0 in 0.601s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:30 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc Nov 02 10:13:30 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:30 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 Nov 02 10:13:30 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:30 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc" returned: 0 in 0.304s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:30 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299" returned: 0 in 0.421s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-quobyte-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc" released by "delete_volume" :: held 0.971s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:30 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 1G Nov 02 10:13:30 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Created reservations ['d86e033e-bdb1-40ee-90be-85c2ccb4eea1', '919bbef9-5fb8-48cd-9c0b-5be3024e128c', '4d0410a6-c277-412f-97f4-ab24b7afd950', '57a5d221-9f74-4430-950e-343f9ffe19f1'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:31 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:31 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-be78956f-1fc7-42e3-8d37-56f8a9989736-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-be78956f-1fc7-42e3-8d37-56f8a9989736-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:31 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.336s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Deleted volume successfully. Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-quobyte-be78956f-1fc7-42e3-8d37-56f8a9989736" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2a8be807-11e8-494f-80c9-c8520ddae524 tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-b9e9a97e-ebb8-4a89-bffa-f52741fd3efc-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-be78956f-1fc7-42e3-8d37-56f8a9989736" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:31 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 1G" returned: 0 in 0.622s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[088df3a2-b772-4b15-a24f-bb412d688b45]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:31 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 Nov 02 10:13:31 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:31 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 Nov 02 10:13:31 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:31 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0" returned: 0 in 0.331s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:31 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 is being set with open permissions: ugo+rw Nov 02 10:13:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:31 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 Nov 02 10:13:31 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:32 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736" returned: 0 in 0.430s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:32 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736 Nov 02 10:13:32 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:32 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0" returned: 0 in 0.324s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:32 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.info Nov 02 10:13:32 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:32 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-be78956f-1fc7-42e3-8d37-56f8a9989736" returned: 0 in 0.310s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-be78956f-1fc7-42e3-8d37-56f8a9989736" released by "delete_volume" :: held 0.803s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Created reservations ['84882528-de04-4ed9-8112-56a48b3f76b8', '1afbd75d-0c5e-4568-908b-9a36c67e3c5b', '22b002f6-98ac-41eb-b8ef-33792d17cdfb', 'b79d0d26-6a08-4e79-9b63-7b8d230b0c34'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:32 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.info" returned: 0 in 0.381s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:32 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.info is being set with open permissions: ugo+rw Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:32 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.info Nov 02 10:13:32 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:32 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:32 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:32 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.info" returned: 0 in 0.306s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:33 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.332s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:33 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Deleted volume successfully. Nov 02 10:13:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c6c89d67-1149-49f8-bfe4-c9147582e812 tempest-VolumesSnapshotTestJSON-118013990 None] Create snapshot completed successfully Nov 02 10:13:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8797f520-796d-4c1c-a1db-16976f714376 tempest-ProjectReaderTests-1555065208 None] Lock "cinder-be78956f-1fc7-42e3-8d37-56f8a9989736-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:33 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Flow 'volume_create_manager' (a03c500a-f65f-4ffb-a694-41c5a15d6dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780c8c4-762a-4f8a-ba89-4bd7b49f5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780c8c4-762a-4f8a-ba89-4bd7b49f5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-801131749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0402fd99-eebc-47be-b8f6-4614102a75d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a717f3571242d4b846334f4a1589ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:33Z,use_quota=True,user_id='20ca3e28416e46f5b13821eceb061032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468c71a5-b393-4034-83a7-e641b29dd30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468c71a5-b393-4034-83a7-e641b29dd30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0448a6-dea0-4944-ab82-48673e242f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0448a6-dea0-4944-ab82-48673e242f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0402fd99-eebc-47be-b8f6-4614102a75d4', 'volume_name': 'volume-0402fd99-eebc-47be-b8f6-4614102a75d4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbd89dd-bd24-406d-bc33-9924ce85eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbd89dd-bd24-406d-bc33-9924ce85eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5441f91-e3d2-43b6-b848-6c90d78adc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:34 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Volume 0402fd99-eebc-47be-b8f6-4614102a75d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0402fd99-eebc-47be-b8f6-4614102a75d4', 'volume_size': 1} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-801131749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0402fd99-eebc-47be-b8f6-4614102a75d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a717f3571242d4b846334f4a1589ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:33Z,use_quota=True,user_id='20ca3e28416e46f5b13821eceb061032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Creating volume 0402fd99-eebc-47be-b8f6-4614102a75d4 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:34 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:34 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 1073741824 Nov 02 10:13:34 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:34 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 1073741824" returned: 0 in 0.462s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-870d400d-af20-4bd3-88bf-dd711e96bea0-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-870d400d-af20-4bd3-88bf-dd711e96bea0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-a18ee036-e538-42e5-8e7b-52f6cfc86299" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-a18ee036-e538-42e5-8e7b-52f6cfc86299" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-870d400d-af20-4bd3-88bf-dd711e96bea0" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-870d400d-af20-4bd3-88bf-dd711e96bea0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Deleting offline snapshot 870d400d-af20-4bd3-88bf-dd711e96bea0 of volume a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] snapshot_file for this snap is: volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[14087030-10d9-4203-8fc1-a2ae77610026]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:35 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 Nov 02 10:13:35 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (ba54b638-eb65-4627-b5e1-bf40c06e9fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01014189-b766-4829-abc8-49466dea06b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:35 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 Nov 02 10:13:35 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01014189-b766-4829-abc8-49466dea06b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60290858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9e3500-e948-4c48-a984-de62bcbaa339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:34Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622465c3-40ac-4616-a0bf-64f2c607ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622465c3-40ac-4616-a0bf-64f2c607ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836e6c1b-5f0f-4974-a5fb-8b8848dedbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836e6c1b-5f0f-4974-a5fb-8b8848dedbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9e3500-e948-4c48-a984-de62bcbaa339', 'volume_name': 'volume-9c9e3500-e948-4c48-a984-de62bcbaa339', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcdf582-542f-4e78-bbc2-4f6e65eb02cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcdf582-542f-4e78-bbc2-4f6e65eb02cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa7b973-0cae-4e47-bc49-118f1dd2481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:35 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Volume 9c9e3500-e948-4c48-a984-de62bcbaa339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9e3500-e948-4c48-a984-de62bcbaa339', 'volume_size': 1} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:35 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0" returned: 0 in 0.401s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a18ee036-e538-42e5-8e7b-52f6cfc86299(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef0471-b52c-4590-8bdf-883f17727932]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:35 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4" returned: 0 in 0.271s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60290858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9e3500-e948-4c48-a984-de62bcbaa339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19515c517784e3ebe895a97b6097952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:34Z,use_quota=True,user_id='e7fbc8fd851647a398f7eada7b1d1d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Creating volume 9c9e3500-e948-4c48-a984-de62bcbaa339 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:35 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 Nov 02 10:13:35 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:35 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:35 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 1073741824 Nov 02 10:13:35 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:36 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299" returned: 0 in 0.381s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:36 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 Nov 02 10:13:36 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:36 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 1073741824" returned: 0 in 0.471s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:36 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0" returned: 0 in 0.374s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:36 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0 Nov 02 10:13:36 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:36 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299.870d400d-af20-4bd3-88bf-dd711e96bea0" returned: 0 in 0.267s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-870d400d-af20-4bd3-88bf-dd711e96bea0" released by "_delete_snapshot" :: held 1.603s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-a18ee036-e538-42e5-8e7b-52f6cfc86299" released by "delete_snapshot" :: held 1.626s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5441f91-e3d2-43b6-b848-6c90d78adc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0402fd99-eebc-47be-b8f6-4614102a75d4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307a4cae-925f-4197-a531-d9f71124eaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Flow 'volume_create_manager' (004ab6f8-0bc0-46f9-844a-a1c88684d202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2831d1-5d5e-4988-9519-f748a76291aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2831d1-5d5e-4988-9519-f748a76291aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578308542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16aa0fed-9869-443b-b290-c0abf131b6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cde879c9e394e3c9f55f3fb80ab0c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:35Z,use_quota=True,user_id='9fbf81dc676548a89070e6d05d389d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c654dc-af42-4c33-ae69-582591b0ffe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c654dc-af42-4c33-ae69-582591b0ffe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412b21f2-48b1-4713-bbcf-0b34e963c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412b21f2-48b1-4713-bbcf-0b34e963c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16aa0fed-9869-443b-b290-c0abf131b6e9', 'volume_name': 'volume-16aa0fed-9869-443b-b290-c0abf131b6e9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa414ed-1553-4de9-b9f5-0cc9d4f7055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa414ed-1553-4de9-b9f5-0cc9d4f7055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b457a33-868c-417c-9c61-414ceddf1ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Volume 16aa0fed-9869-443b-b290-c0abf131b6e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16aa0fed-9869-443b-b290-c0abf131b6e9', 'volume_size': 1} Nov 02 10:13:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:39 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Volume volume-0402fd99-eebc-47be-b8f6-4614102a75d4 (0402fd99-eebc-47be-b8f6-4614102a75d4): created successfully Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307a4cae-925f-4197-a531-d9f71124eaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Flow 'volume_create_manager' (a03c500a-f65f-4ffb-a694-41c5a15d6dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['33cd836d-221f-47c1-a31b-49d53bae073a', '210158f2-73ff-497a-9edf-569aa45870e6', '4879574a-1dd5-4a76-b303-dec9d594c729', 'f0f57f60-5cf8-41c8-96d9-56915eeddab0'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-26fcac18-0699-412c-9b25-1afada76299a tempest-VolumesTransfersV355Test-1481924930 None] Created volume successfully. Nov 02 10:13:39 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 Nov 02 10:13:39 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Delete snapshot completed successfully. Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85ccfa74-e9f7-438f-81ae-c2fcc4301117 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-870d400d-af20-4bd3-88bf-dd711e96bea0-delete_snapshot" released by "delete_snapshot" :: held 4.249s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:39 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339" returned: 0 in 0.345s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] <== create_volume: return (3629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.643s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.279s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578308542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16aa0fed-9869-443b-b290-c0abf131b6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cde879c9e394e3c9f55f3fb80ab0c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:35Z,use_quota=True,user_id='9fbf81dc676548a89070e6d05d389d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Creating volume 16aa0fed-9869-443b-b290-c0abf131b6e9 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:39 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:39 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 1073741824 Nov 02 10:13:39 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa7b973-0cae-4e47-bc49-118f1dd2481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9e3500-e948-4c48-a984-de62bcbaa339', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ef7592-9b03-46b5-9069-2ff1a6e3cfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=241,cinder:SELECT=171,cinder:INSERT=66,cinder:DELETE=21 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:39 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Volume volume-9c9e3500-e948-4c48-a984-de62bcbaa339 (9c9e3500-e948-4c48-a984-de62bcbaa339): created successfully Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ef7592-9b03-46b5-9069-2ff1a6e3cfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Flow 'volume_create_manager' (ba54b638-eb65-4627-b5e1-bf40c06e9fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:39 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=195,cinder:UPDATE=239,cinder:INSERT=66,cinder:DELETE=20 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-bf52a88c-54be-4a72-bf2b-82b64b2582de tempest-ProjectReaderTests-1555065208 None] Created volume successfully. Nov 02 10:13:40 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 1073741824" returned: 0 in 0.589s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:40 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 Nov 02 10:13:40 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Acquiring lock "cinder-0402fd99-eebc-47be-b8f6-4614102a75d4-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-0402fd99-eebc-47be-b8f6-4614102a75d4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Acquiring lock "cinder-quobyte-0402fd99-eebc-47be-b8f6-4614102a75d4" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-quobyte-0402fd99-eebc-47be-b8f6-4614102a75d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65247c3-79d5-46d8-9fb6-3ac2e66a416a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:40 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9" returned: 0 in 0.340s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:40 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 Nov 02 10:13:40 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (e14329a4-026c-44be-8b44-e32c711c41ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747fc0ef-b5c9-48c6-afd1-59b0184deee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b457a33-868c-417c-9c61-414ceddf1ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16aa0fed-9869-443b-b290-c0abf131b6e9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0ce51b-3598-43e2-ad66-4d7afed8c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747fc0ef-b5c9-48c6-afd1-59b0184deee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1102397533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bb8116-414d-488f-a0dc-992082c79961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:40Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2a2728-251c-4839-b50a-6d36b270ae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2a2728-251c-4839-b50a-6d36b270ae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507146d5-ab91-4e3e-8dcd-10eacec37b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507146d5-ab91-4e3e-8dcd-10eacec37b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bb8116-414d-488f-a0dc-992082c79961', 'volume_name': 'volume-b5bb8116-414d-488f-a0dc-992082c79961', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786739ab-445b-4c00-8efe-6f2a458c58d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786739ab-445b-4c00-8efe-6f2a458c58d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77abd900-74d6-406f-b8fe-e1b870b1df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:40 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Volume b5bb8116-414d-488f-a0dc-992082c79961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bb8116-414d-488f-a0dc-992082c79961', 'volume_size': 1} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1102397533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bb8116-414d-488f-a0dc-992082c79961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:40Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Creating volume b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:40 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-9c9e3500-e948-4c48-a984-de62bcbaa339-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:40 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Volume volume-16aa0fed-9869-443b-b290-c0abf131b6e9 (16aa0fed-9869-443b-b290-c0abf131b6e9): created successfully Nov 02 10:13:40 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 1073741824 Nov 02 10:13:40 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0ce51b-3598-43e2-ad66-4d7afed8c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Flow 'volume_create_manager' (004ab6f8-0bc0-46f9-844a-a1c88684d202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Lock "cinder-9c9e3500-e948-4c48-a984-de62bcbaa339-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:40 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-72fbe52b-72a7-45ab-ae08-10c0e6af8c32 tempest-ProjectReaderTests-606344097 None] Created volume successfully. Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Acquiring lock "cinder-quobyte-9c9e3500-e948-4c48-a984-de62bcbaa339" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-9c9e3500-e948-4c48-a984-de62bcbaa339" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:40 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4" returned: 0 in 0.490s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b67d9c-3c7a-476d-9ceb-3e122167e075]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:40 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4 Nov 02 10:13:40 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:41 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 Nov 02 10:13:41 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:41 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0402fd99-eebc-47be-b8f6-4614102a75d4" returned: 0 in 0.326s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Acquiring lock "cinder-16aa0fed-9869-443b-b290-c0abf131b6e9-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-quobyte-0402fd99-eebc-47be-b8f6-4614102a75d4" released by "delete_volume" :: held 0.892s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Lock "cinder-16aa0fed-9869-443b-b290-c0abf131b6e9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Acquiring lock "cinder-quobyte-16aa0fed-9869-443b-b290-c0abf131b6e9" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Created reservations ['39d3b8c4-a7ab-42e0-a90f-aefb19bafa34', 'f0795de1-b597-4045-948d-d97abfe2889b', '7cd11113-e721-4a6d-8f9f-0b757ea668e1', '0cafc8b6-fcfd-4068-87b5-befdcf5e439c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Lock "cinder-quobyte-16aa0fed-9869-443b-b290-c0abf131b6e9" acquired by "delete_volume" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:41 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 1073741824" returned: 0 in 0.701s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[742ed166-5e6a-4cbb-b43e-5888db9e2272]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:41 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339" returned: 0 in 0.545s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:41 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339 Nov 02 10:13:41 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:41 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 Nov 02 10:13:41 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:41 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:41 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:41 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 Nov 02 10:13:41 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:41 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9c9e3500-e948-4c48-a984-de62bcbaa339" returned: 0 in 0.314s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Lock "cinder-quobyte-9c9e3500-e948-4c48-a984-de62bcbaa339" released by "delete_volume" :: held 0.941s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:41 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961" returned: 0 in 0.334s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:41 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.324s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77abd900-74d6-406f-b8fe-e1b870b1df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bb8116-414d-488f-a0dc-992082c79961', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f572d70c-eaf8-4f52-b502-eff13c911957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Deleted volume successfully. Nov 02 10:13:41 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Volume volume-b5bb8116-414d-488f-a0dc-992082c79961 (b5bb8116-414d-488f-a0dc-992082c79961): created successfully Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f572d70c-eaf8-4f52-b502-eff13c911957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (e14329a4-026c-44be-8b44-e32c711c41ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Created reservations ['c552f209-6e3d-43cf-b2ea-ad14b65eb1d0', 'a6f144a9-c517-4fff-8a8f-74c426077b96', '6b54bb74-747a-46d7-8906-f33334a7036d', 'cc6074cf-b1e1-4702-85c8-8a2091cbc4cb'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:41 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-78edb76d-de33-4ab6-ae4f-2f099be8a76c tempest-VolumesTransfersV355Test-654037487 None] Lock "cinder-0402fd99-eebc-47be-b8f6-4614102a75d4-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d372f08b-c924-47c1-b671-384cdf91fc3c tempest-VolumesSnapshotTestJSON-118013990 None] Created volume successfully. Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9" returned: 0 in 0.583s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:42 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9 Nov 02 10:13:42 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:42 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:42 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:42 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-16aa0fed-9869-443b-b290-c0abf131b6e9" returned: 0 in 0.308s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Lock "cinder-quobyte-16aa0fed-9869-443b-b290-c0abf131b6e9" released by "delete_volume" :: held 0.965s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Created reservations ['1be63f6f-b773-4373-a42b-43ba1e981bf9', '122b247d-0ff8-4dd8-9594-09df34180812', '90a791da-cd7a-410c-810b-304c1c00a3d9', '58b753e1-f633-4bf0-b368-cfde51d5fc25'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:42 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.335s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:42 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Deleted volume successfully. Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9833f3f2-77d1-4f5d-8f8c-4f3790485faa tempest-ProjectReaderTests-1555065208 None] Lock "cinder-9c9e3500-e948-4c48-a984-de62bcbaa339-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:42 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:42 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:42 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.389s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:42 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Deleted volume successfully. Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Creating offline snapshot feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 of volume b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:13:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b84e225c-1173-4ae0-a580-dd34c4de07f7 tempest-ProjectReaderTests-606344097 None] Lock "cinder-16aa0fed-9869-443b-b290-c0abf131b6e9-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[34909b13-ee1d-43f9-869e-624959123e39]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:43 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 Nov 02 10:13:43 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:43 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961" returned: 0 in 0.621s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:43 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 1G Nov 02 10:13:43 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Flow 'volume_create_manager' (d5b8e9bd-26a4-40d0-9e59-0dc9b50f0b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e4d48-af20-4ee7-927f-435785f40d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e4d48-af20-4ee7-927f-435785f40d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013015811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3706607-e8d3-46e4-98a1-319ac89f1448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cde879c9e394e3c9f55f3fb80ab0c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:44Z,use_quota=True,user_id='9fbf81dc676548a89070e6d05d389d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc86dbb1-4942-47a3-9cb0-4a4abf422151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc86dbb1-4942-47a3-9cb0-4a4abf422151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be9bb29-3050-400b-ba4f-c5cfff3adf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be9bb29-3050-400b-ba4f-c5cfff3adf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3706607-e8d3-46e4-98a1-319ac89f1448', 'volume_name': 'volume-e3706607-e8d3-46e4-98a1-319ac89f1448', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b59817a-eeb1-4964-9f35-d66bdf000f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b59817a-eeb1-4964-9f35-d66bdf000f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b65975-00f1-4659-ad5b-e9eab14299df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Volume e3706607-e8d3-46e4-98a1-319ac89f1448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3706607-e8d3-46e4-98a1-319ac89f1448', 'volume_size': 1} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:44 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 1G" returned: 0 in 0.679s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5bb8116-414d-488f-a0dc-992082c79961 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:44 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5bb8116-414d-488f-a0dc-992082c79961 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 Nov 02 10:13:44 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:44 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5bb8116-414d-488f-a0dc-992082c79961 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" returned: 0 in 0.363s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:44 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 is being set with open permissions: ugo+rw Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:44 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 Nov 02 10:13:44 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:44 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" returned: 0 in 0.266s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:45 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.info Nov 02 10:13:45 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:45 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.info" returned: 0 in 0.391s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:45 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.info is being set with open permissions: ugo+rw Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:45 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.info Nov 02 10:13:45 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:45 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.info" returned: 0 in 0.318s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.832s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013015811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3706607-e8d3-46e4-98a1-319ac89f1448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cde879c9e394e3c9f55f3fb80ab0c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:44Z,use_quota=True,user_id='9fbf81dc676548a89070e6d05d389d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Creating volume e3706607-e8d3-46e4-98a1-319ac89f1448 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:45 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:45 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 1073741824 Nov 02 10:13:45 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8670337f-23ad-42f6-9c58-03aa9209796f tempest-VolumesSnapshotTestJSON-118013990 None] Create snapshot completed successfully Nov 02 10:13:46 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 1073741824" returned: 0 in 0.621s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:46 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 Nov 02 10:13:46 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:46 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448" returned: 0 in 0.341s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b65975-00f1-4659-ad5b-e9eab14299df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3706607-e8d3-46e4-98a1-319ac89f1448', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c5b007-80c2-4332-9969-567292544345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Volume volume-e3706607-e8d3-46e4-98a1-319ac89f1448 (e3706607-e8d3-46e4-98a1-319ac89f1448): created successfully Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c5b007-80c2-4332-9969-567292544345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Flow 'volume_create_manager' (d5b8e9bd-26a4-40d0-9e59-0dc9b50f0b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-76198f1f-7436-48b9-ba2d-c2950d91d290 tempest-ProjectReaderTests-606344097 None] Created volume successfully. Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (f89c436d-a0a0-40f8-9c15-c55ff86d7e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135861cb-2e1d-4821-98aa-5ec2434ac6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135861cb-2e1d-4821-98aa-5ec2434ac6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-930905626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f770da6e-e8ec-4f7b-90a4-065fe005c4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:47Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb69a1b-fb1b-4f21-ae20-0a18ab35b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb69a1b-fb1b-4f21-ae20-0a18ab35b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97493637-2597-4310-a304-a8df34fb6247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97493637-2597-4310-a304-a8df34fb6247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f770da6e-e8ec-4f7b-90a4-065fe005c4ba', 'volume_name': 'volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba', 'volume_size': 2, 'snapshot_id': 'feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11e5b72-63eb-4d45-93cb-54339e8cff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11e5b72-63eb-4d45-93cb-54339e8cff2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbaf790-a6f5-46ea-936a-596ce2f0a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:47 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Volume f770da6e-e8ec-4f7b-90a4-065fe005c4ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba', 'volume_size': 2, 'snapshot_id': 'feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2'} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Creating volume f770da6e-e8ec-4f7b-90a4-065fe005c4ba from snapshot feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] snapshot: feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2, volume: f770da6e-e8ec-4f7b-90a4-065fe005c4ba, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a79d0c1-b00b-4963-8a68-45cdf52adeee]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:47 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 Nov 02 10:13:47 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Acquiring lock "cinder-e3706607-e8d3-46e4-98a1-319ac89f1448-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Lock "cinder-e3706607-e8d3-46e4-98a1-319ac89f1448-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Acquiring lock "cinder-quobyte-e3706607-e8d3-46e4-98a1-319ac89f1448" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Lock "cinder-quobyte-e3706607-e8d3-46e4-98a1-319ac89f1448" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d9e86-b378-4e06-9195-7d93f1902c17]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:47 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 Nov 02 10:13:47 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:47 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" returned: 0 in 0.502s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5bb8116-414d-488f-a0dc-992082c79961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb721cb-b19a-41d9-92a4-019c55db2092]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:47 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 Nov 02 10:13:47 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:48 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448" returned: 0 in 0.535s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:48 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448 Nov 02 10:13:48 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:48 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961" returned: 0 in 0.470s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:48 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba Nov 02 10:13:48 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:48 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e3706607-e8d3-46e4-98a1-319ac89f1448" returned: 0 in 0.284s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Lock "cinder-quobyte-e3706607-e8d3-46e4-98a1-319ac89f1448" released by "delete_volume" :: held 0.878s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Created reservations ['f2f47a7b-3974-47db-82e1-05b182d22589', '7a28b86f-9e9b-4714-b67d-623e3e9b455d', '53bb28de-fc9f-4c1f-b7ec-2250255d20ba', 'cdcb05d7-2017-4be0-9d05-37cdfedf64dc'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:48 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:48 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:48 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:48 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:48 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:48 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Deleted volume successfully. Nov 02 10:13:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3e0b1b6-8483-44d6-b2e0-f0c9b5daad15 tempest-ProjectReaderTests-606344097 None] Lock "cinder-e3706607-e8d3-46e4-98a1-319ac89f1448-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:49 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.555s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:13:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:13:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Flow 'volume_create_manager' (0d6c4e2a-7514-4917-9dfa-2a53bc761670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fad0a2-ce6a-44e3-a471-929fc6b3bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fad0a2-ce6a-44e3-a471-929fc6b3bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-414083247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f3842e-f6d7-40b8-8fa1-81f5d376b10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f55976186648a183dcbd79ad4614a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:54Z,use_quota=True,user_id='b7ce12dd647d4ceaa6c9ad0e98990a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec82736-ce7c-4ab4-8179-8957ccd4432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec82736-ce7c-4ab4-8179-8957ccd4432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5882573-4d4c-400f-a0f2-a618a0fc66d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5882573-4d4c-400f-a0f2-a618a0fc66d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f3842e-f6d7-40b8-8fa1-81f5d376b10f', 'volume_name': 'volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff11a06-159d-4068-a767-07a40fc0028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff11a06-159d-4068-a767-07a40fc0028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f08f7ef-43d0-4a37-b092-127a02e84769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:53 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Volume e8f3842e-f6d7-40b8-8fa1-81f5d376b10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f', 'volume_size': 1} Nov 02 10:13:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:55 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" returned: 0 in 7.407s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:13:55 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Converted 1024.00 MB image at 138.23 MB/s Nov 02 10:13:55 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba is being set with open permissions: ugo+rw Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:55 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba Nov 02 10:13:55 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:55 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" returned: 0 in 0.240s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" released by "_copy_volume_from_snapshot" :: held 8.744s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" released by "_create_volume_from_snapshot" :: held 8.813s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.835s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.123s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-414083247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f3842e-f6d7-40b8-8fa1-81f5d376b10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f55976186648a183dcbd79ad4614a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:54Z,use_quota=True,user_id='b7ce12dd647d4ceaa6c9ad0e98990a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Creating volume e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:55 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:55 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f 1073741824 Nov 02 10:13:55 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbaf790-a6f5-46ea-936a-596ce2f0a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba', 'volume_size': 2, 'snapshot_id': 'feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95bf7b9-9f6d-4ce8-a5de-f03792b13c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:55 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Volume volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba (f770da6e-e8ec-4f7b-90a4-065fe005c4ba): created successfully Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95bf7b9-9f6d-4ce8-a5de-f03792b13c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (f89c436d-a0a0-40f8-9c15-c55ff86d7e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4dfc76a0-df81-47d3-9752-e38a754e038e tempest-VolumesSnapshotTestJSON-118013990 None] Created volume successfully. Nov 02 10:13:56 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f 1073741824" returned: 0 in 0.415s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:56 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f Nov 02 10:13:56 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:56 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" returned: 0 in 0.244s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f08f7ef-43d0-4a37-b092-127a02e84769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bed1f5-fc5a-44d5-b2e9-880e04d2ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:56 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Volume volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f (e8f3842e-f6d7-40b8-8fa1-81f5d376b10f): created successfully Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bed1f5-fc5a-44d5-b2e9-880e04d2ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Flow 'volume_create_manager' (0d6c4e2a-7514-4917-9dfa-2a53bc761670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:56 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-53d4525a-1122-4810-99af-3ac40f8b2518 tempest-VolumesCloneTest-416910668 None] Created volume successfully. Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-f770da6e-e8ec-4f7b-90a4-065fe005c4ba-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-f770da6e-e8ec-4f7b-90a4-065fe005c4ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" acquired by "delete_volume" :: waited 0.013s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[435ccef9-c7fb-41d5-ba8c-f92eeed3943a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:57 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba Nov 02 10:13:57 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:57 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" returned: 0 in 0.360s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:57 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba Nov 02 10:13:57 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:57 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" returned: 0 in 0.241s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-f770da6e-e8ec-4f7b-90a4-065fe005c4ba" released by "delete_volume" :: held 0.643s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['ff7c12dd-c8e6-48d3-922d-089d4a890b3d', '730d3052-9a7d-4460-86f1-6589c0daa886', '104cf919-8a04-4126-ae63-3c6186fc105f', '68fbd868-276d-4d0b-8151-e489c82d7f84'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:57 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:13:57 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:57 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.252s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Deleted volume successfully. Nov 02 10:13:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cef0e24e-7aef-43a0-8a1c-75f4db1f7e7f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-f770da6e-e8ec-4f7b-90a4-065fe005c4ba-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-b5bb8116-414d-488f-a0dc-992082c79961" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-b5bb8116-414d-488f-a0dc-992082c79961" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Deleting offline snapshot feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 of volume b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] snapshot_file for this snap is: volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc0c9e-c69c-4156-8a0d-c8ecb51cdb20]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Flow 'volume_create_manager' (2eee7fc8-8d1c-4e7c-b788-b9610a5e3630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:58 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 Nov 02 10:13:58 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bf84bf-6d0d-4114-adb4-4d449b5f6fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bf84bf-6d0d-4114-adb4-4d449b5f6fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-247716921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47522747-4222-40e1-a657-abfaca396b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f55976186648a183dcbd79ad4614a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e8f3842e-f6d7-40b8-8fa1-81f5d376b10f,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:58Z,use_quota=True,user_id='b7ce12dd647d4ceaa6c9ad0e98990a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2daf2a5a-4f2c-4b45-a8dc-c43a709df366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2daf2a5a-4f2c-4b45-a8dc-c43a709df366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5295a1-8200-4cd9-97bf-cf49c674bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5295a1-8200-4cd9-97bf-cf49c674bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '47522747-4222-40e1-a657-abfaca396b62', 'volume_name': 'volume-47522747-4222-40e1-a657-abfaca396b62', 'volume_size': 2, 'source_volid': 'e8f3842e-f6d7-40b8-8fa1-81f5d376b10f', 'source_volstatus': 'available'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc179d98-a980-449f-98d8-633ba97abc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc179d98-a980-449f-98d8-633ba97abc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760f25cf-4d93-412f-aac5-4eedca81493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:58 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Volume 47522747-4222-40e1-a657-abfaca396b62: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-47522747-4222-40e1-a657-abfaca396b62', 'volume_size': 2, 'source_volid': 'e8f3842e-f6d7-40b8-8fa1-81f5d376b10f', 'source_volstatus': 'available'} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:58 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Cloning volume e8f3842e-f6d7-40b8-8fa1-81f5d376b10f to volume 47522747-4222-40e1-a657-abfaca396b62 Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Creating offline snapshot ec9c59b6-f84c-40e2-90ba-a983ce4744a1 of volume e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[94003da9-f26c-4b51-8c6c-2987de7dcbb5]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:58 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f Nov 02 10:13:58 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:58 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" returned: 0 in 0.369s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5bb8116-414d-488f-a0dc-992082c79961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0327aa6e-2ebc-429f-856c-1461d5d53aff]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:58 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 Nov 02 10:13:58 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:58 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" returned: 0 in 0.366s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:58 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 1G Nov 02 10:13:58 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:59 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961" returned: 0 in 0.534s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:59 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 Nov 02 10:13:59 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:59 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 1G" returned: 0 in 0.434s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:59 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 Nov 02 10:13:59 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:59 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" returned: 0 in 0.337s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:59 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2 Nov 02 10:13:59 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:59 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1" returned: 0 in 0.293s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:59 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 is being set with open permissions: ugo+rw Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:59 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 Nov 02 10:13:59 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:59 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961.feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" returned: 0 in 0.249s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2" released by "_delete_snapshot" :: held 1.595s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-b5bb8116-414d-488f-a0dc-992082c79961" released by "delete_snapshot" :: held 1.627s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:59 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1" returned: 0 in 0.246s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:59 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.info Nov 02 10:13:59 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['217f26a5-d73c-4d83-844b-ed0f5a5e1982', 'e2738af9-1f7b-4e9f-aa72-f56d69ffab6e', '1971e14f-94fc-4095-ad5c-1bae2b9f760c', '8c082d5c-8c8b-4163-98ad-5aaa0d3fab83'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:59 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Delete snapshot completed successfully. Nov 02 10:13:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-50fbe486-bd04-4d8e-9fe6-a90930013000 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-feb5bd76-cb29-4cd9-a0bc-8c064ac94ae2-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:00 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.info" returned: 0 in 0.246s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:00 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.info is being set with open permissions: ugo+rw Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:00 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.info Nov 02 10:14:00 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:00 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.info" returned: 0 in 0.253s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Acquiring lock "cinder-quobyte-47522747-4222-40e1-a657-abfaca396b62" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-b5bb8116-414d-488f-a0dc-992082c79961-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-47522747-4222-40e1-a657-abfaca396b62" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] snapshot: ec9c59b6-f84c-40e2-90ba-a983ce4744a1, volume: 47522747-4222-40e1-a657-abfaca396b62, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-b5bb8116-414d-488f-a0dc-992082c79961-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ece0a2-fd4a-47bd-bbe2-bd16e531c007]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-b5bb8116-414d-488f-a0dc-992082c79961" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-b5bb8116-414d-488f-a0dc-992082c79961" acquired by "delete_volume" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6ad086-8f00-4bcc-858e-1279a3e6d991]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:00 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 Nov 02 10:14:00 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:00 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 Nov 02 10:14:00 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:00 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1" returned: 0 in 0.347s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb579fef-5581-4768-858a-4cd91fde8a66]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:00 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f Nov 02 10:14:00 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:00 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961" returned: 0 in 0.369s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:00 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961 Nov 02 10:14:00 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:01 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:01 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b5bb8116-414d-488f-a0dc-992082c79961" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" returned: 0 in 0.372s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-b5bb8116-414d-488f-a0dc-992082c79961" released by "delete_volume" :: held 0.724s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:01 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 Nov 02 10:14:01 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['ee1f51b1-04f5-4667-bce7-8b73aca15012', '06d43cd4-d2a8-4744-bccf-2a3e9a639f14', 'f48f5984-f52b-40c2-9b58-1f596c6cfede', '9ec71345-cc56-4b1e-9b69-ac81244c7885'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:01 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:01 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:01 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.261s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Deleted volume successfully. Nov 02 10:14:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ec952e4a-d6d3-4451-9c10-a11d65702bec tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-b5bb8116-414d-488f-a0dc-992082c79961-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (5bb04211-67e2-4281-8232-df83e6fb9a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af663a26-2e4e-413e-8d35-19870b7a13dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af663a26-2e4e-413e-8d35-19870b7a13dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1272042189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f65ea32-ff80-405b-bbd7-325c461dc640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:02Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e776f01-5d0c-4ebe-ae4a-1e928b742f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e776f01-5d0c-4ebe-ae4a-1e928b742f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59db2ee6-d389-4a1e-82b4-1a69db061fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59db2ee6-d389-4a1e-82b4-1a69db061fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f65ea32-ff80-405b-bbd7-325c461dc640', 'volume_name': 'volume-3f65ea32-ff80-405b-bbd7-325c461dc640', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d9ea76-f429-457e-a999-785deff5321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d9ea76-f429-457e-a999-785deff5321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f640a6bb-3dce-4b09-843c-85fd7df12405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:02 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Volume 3f65ea32-ff80-405b-bbd7-325c461dc640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f65ea32-ff80-405b-bbd7-325c461dc640', 'volume_size': 1} Nov 02 10:14:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:07 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62" returned: 0 in 5.946s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:07 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Converted 1024.00 MB image at 172.19 MB/s Nov 02 10:14:07 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 is being set with open permissions: ugo+rw Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:07 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 Nov 02 10:14:07 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:07 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62" returned: 0 in 0.232s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-47522747-4222-40e1-a657-abfaca396b62" released by "_copy_volume_from_snapshot" :: held 6.983s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Acquiring lock "cinder-quobyte-ec9c59b6-f84c-40e2-90ba-a983ce4744a1" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-ec9c59b6-f84c-40e2-90ba-a983ce4744a1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Deleting offline snapshot ec9c59b6-f84c-40e2-90ba-a983ce4744a1 of volume e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] snapshot_file for this snap is: volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[63362123-9001-4ee7-aba2-29a73beb191d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:07 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 Nov 02 10:14:07 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:07 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[25490adc-5e05-4ed9-ba93-69cac6d2d9d9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:08 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f Nov 02 10:14:08 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:08 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" returned: 0 in 0.528s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:08 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 Nov 02 10:14:08 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:08 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1" returned: 0 in 0.322s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:08 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1 Nov 02 10:14:08 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:09 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f.ec9c59b6-f84c-40e2-90ba-a983ce4744a1" returned: 0 in 0.231s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-ec9c59b6-f84c-40e2-90ba-a983ce4744a1" released by "_delete_snapshot" :: held 1.569s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.637s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.406s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1272042189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f65ea32-ff80-405b-bbd7-325c461dc640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:02Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Creating volume 3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:09 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760f25cf-4d93-412f-aac5-4eedca81493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47522747-4222-40e1-a657-abfaca396b62', 'volume_size': 2, 'source_volid': 'e8f3842e-f6d7-40b8-8fa1-81f5d376b10f', 'source_volstatus': 'available'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:09 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 1073741824 Nov 02 10:14:09 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8bd5fa-19a6-40bb-b3e7-2ce27d561c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Volume volume-47522747-4222-40e1-a657-abfaca396b62 (47522747-4222-40e1-a657-abfaca396b62): created successfully Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8bd5fa-19a6-40bb-b3e7-2ce27d561c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Flow 'volume_create_manager' (2eee7fc8-8d1c-4e7c-b788-b9610a5e3630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f3612461-3f69-4db2-aace-411e3c4d0cc2 tempest-VolumesCloneTest-416910668 None] Created volume successfully. Nov 02 10:14:09 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 1073741824" returned: 0 in 0.437s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:09 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 Nov 02 10:14:09 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:09 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640" returned: 0 in 0.231s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f640a6bb-3dce-4b09-843c-85fd7df12405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f65ea32-ff80-405b-bbd7-325c461dc640', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69581fc3-a60e-4fd5-a939-ab6e00688270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Volume volume-3f65ea32-ff80-405b-bbd7-325c461dc640 (3f65ea32-ff80-405b-bbd7-325c461dc640): created successfully Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69581fc3-a60e-4fd5-a939-ab6e00688270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (5bb04211-67e2-4281-8232-df83e6fb9a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6a34f942-62bb-45a1-bd48-99358ceb63fa tempest-VolumesSnapshotTestJSON-118013990 None] Created volume successfully. Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Acquiring lock "cinder-47522747-4222-40e1-a657-abfaca396b62-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Lock "cinder-47522747-4222-40e1-a657-abfaca396b62-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Acquiring lock "cinder-quobyte-47522747-4222-40e1-a657-abfaca396b62" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-47522747-4222-40e1-a657-abfaca396b62" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62e73b-d299-4d6e-b35f-032421cf8213]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:10 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 Nov 02 10:14:10 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:10 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:10 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62 Nov 02 10:14:10 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Creating offline snapshot e71d7ea6-449c-46dc-a63b-1cfd632cb10c of volume 3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf43a64-69c6-450c-990a-31d8f3337984]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:11 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-47522747-4222-40e1-a657-abfaca396b62" returned: 0 in 0.303s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-47522747-4222-40e1-a657-abfaca396b62" released by "delete_volume" :: held 0.737s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:11 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 Nov 02 10:14:11 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Created reservations ['14695594-fafc-4bf9-a205-76f4c426fde4', 'cbd1d199-1cad-4491-b41c-e2b4317774f0', '6e41a710-7308-497a-9521-80a5913a30a5', 'b5e66443-2aa3-4200-9622-73b2af7370aa'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:11 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:11 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:11 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640" returned: 0 in 0.419s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:11 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c 1G Nov 02 10:14:11 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:11 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Deleted volume successfully. Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Acquiring lock "cinder-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-192faea7-eaa0-4338-8971-f8a313f98bf4 tempest-VolumesCloneTest-416910668 None] Lock "cinder-47522747-4222-40e1-a657-abfaca396b62-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Lock "cinder-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Acquiring lock "cinder-quobyte-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd70d0-a745-41b7-b67c-95a93fd8917a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:11 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f Nov 02 10:14:11 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:12 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c 1G" returned: 0 in 0.436s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f65ea32-ff80-405b-bbd7-325c461dc640 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:12 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f65ea32-ff80-405b-bbd7-325c461dc640 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c Nov 02 10:14:12 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:12 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" returned: 0 in 0.412s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:12 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f Nov 02 10:14:12 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:12 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f65ea32-ff80-405b-bbd7-325c461dc640 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c" returned: 0 in 0.315s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c is being set with open permissions: ugo+rw Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:12 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c Nov 02 10:14:12 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:12 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" returned: 0 in 0.270s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Lock "cinder-quobyte-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f" released by "delete_volume" :: held 0.748s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Created reservations ['62f00be5-3293-4a40-a6a1-c77a5011a5e3', '76d7611c-bc67-4d70-8367-8bc89efb6331', 'edfed554-c933-4058-806d-27d26484bf0d', '7134ca69-35ee-4227-99f8-4cdfd748797a'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:12 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c" returned: 0 in 0.272s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:12 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:12 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:12 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.info Nov 02 10:14:12 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:12 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Deleted volume successfully. Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-69b641fb-a143-4731-b998-6c66e6558624 tempest-VolumesCloneTest-416910668 None] Lock "cinder-e8f3842e-f6d7-40b8-8fa1-81f5d376b10f-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:12 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.info" returned: 0 in 0.281s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.info is being set with open permissions: ugo+rw Nov 02 10:14:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:12 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.info Nov 02 10:14:12 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:13 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.info" returned: 0 in 0.283s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:13 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ed0f2d22-3fa2-4aa5-9671-44d5df1a1d28 tempest-VolumesSnapshotTestJSON-118013990 None] Create snapshot completed successfully Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (7a500254-201f-46ef-b85b-55192c9f10ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0496ab4-3f95-4f1f-8d01-3db8b164feab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0496ab4-3f95-4f1f-8d01-3db8b164feab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1948987091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8655747-95d9-49c4-be7c-77f94e47e159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf670d95c44d9fb84ab0fe198c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e71d7ea6-449c-46dc-a63b-1cfd632cb10c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:15Z,use_quota=True,user_id='f6fd61b2d33749f98be7519476552023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b35e28a-00a5-4e2f-a3f2-d7e6d490ddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b35e28a-00a5-4e2f-a3f2-d7e6d490ddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8ca077-7e24-4d05-8ce7-19e789e1ed6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8ca077-7e24-4d05-8ce7-19e789e1ed6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd8655747-95d9-49c4-be7c-77f94e47e159', 'volume_name': 'volume-d8655747-95d9-49c4-be7c-77f94e47e159', 'volume_size': 1, 'snapshot_id': 'e71d7ea6-449c-46dc-a63b-1cfd632cb10c'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b40589-71f9-499b-94a2-3ad8b25bc388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b40589-71f9-499b-94a2-3ad8b25bc388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86563c4-3f7b-4fee-a4c7-c11f011abf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:15 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Volume d8655747-95d9-49c4-be7c-77f94e47e159: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d8655747-95d9-49c4-be7c-77f94e47e159', 'volume_size': 1, 'snapshot_id': 'e71d7ea6-449c-46dc-a63b-1cfd632cb10c'} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-e71d7ea6-449c-46dc-a63b-1cfd632cb10c-d8655747-95d9-49c4-be7c-77f94e47e159" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-e71d7ea6-449c-46dc-a63b-1cfd632cb10c-d8655747-95d9-49c4-be7c-77f94e47e159" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Creating volume d8655747-95d9-49c4-be7c-77f94e47e159 from snapshot e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-d8655747-95d9-49c4-be7c-77f94e47e159" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-d8655747-95d9-49c4-be7c-77f94e47e159" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] snapshot: e71d7ea6-449c-46dc-a63b-1cfd632cb10c, volume: d8655747-95d9-49c4-be7c-77f94e47e159, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e4914-8939-4898-84b5-db0e4d0ae18d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:15 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c Nov 02 10:14:15 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:15 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c" returned: 0 in 0.362s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f65ea32-ff80-405b-bbd7-325c461dc640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de4c18-ec40-4f34-b787-dbd57542678a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:15 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 Nov 02 10:14:15 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:16 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640" returned: 0 in 0.383s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:14:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:14:16 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:14:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:16 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 Nov 02 10:14:16 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (c9a346c7-519e-4d20-ba6a-fc6129bf50da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad3061d-298f-43f7-9104-66d2560875ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad3061d-298f-43f7-9104-66d2560875ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-667697363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba09c88-8e1a-4bb0-b25a-01bc3c172f43,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:17Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862336e4-3e70-4772-8b4f-29d4e1f927b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862336e4-3e70-4772-8b4f-29d4e1f927b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc730ff2-ab58-4e32-8e09-917dca189783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc730ff2-ab58-4e32-8e09-917dca189783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba09c88-8e1a-4bb0-b25a-01bc3c172f43', 'volume_name': 'volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4408e5f2-6bda-477c-9c03-c916cedd3721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4408e5f2-6bda-477c-9c03-c916cedd3721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19917c3a-7a9e-4699-ad02-a669eb597208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Volume 9ba09c88-8e1a-4bb0-b25a-01bc3c172f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43', 'volume_size': 1} Nov 02 10:14:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:21 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159" returned: 0 in 5.948s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:21 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:21 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Converted 1024.00 MB image at 172.14 MB/s Nov 02 10:14:21 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 is being set with open permissions: ugo+rw Nov 02 10:14:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:22 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 Nov 02 10:14:22 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:22 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159" returned: 0 in 0.266s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-d8655747-95d9-49c4-be7c-77f94e47e159" released by "_copy_volume_from_snapshot" :: held 7.052s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-e71d7ea6-449c-46dc-a63b-1cfd632cb10c-d8655747-95d9-49c4-be7c-77f94e47e159" released by "_create_volume_from_snapshot" :: held 7.123s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.159s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.810s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-667697363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba09c88-8e1a-4bb0-b25a-01bc3c172f43,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:17Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Creating volume 9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:22 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:22 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 1073741824 Nov 02 10:14:22 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86563c4-3f7b-4fee-a4c7-c11f011abf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8655747-95d9-49c4-be7c-77f94e47e159', 'volume_size': 1, 'snapshot_id': 'e71d7ea6-449c-46dc-a63b-1cfd632cb10c'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada068b-ebb1-46cd-b97e-d19cc87d3df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Volume volume-d8655747-95d9-49c4-be7c-77f94e47e159 (d8655747-95d9-49c4-be7c-77f94e47e159): created successfully Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada068b-ebb1-46cd-b97e-d19cc87d3df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Flow 'volume_create_manager' (7a500254-201f-46ef-b85b-55192c9f10ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fef9dee4-232d-4ded-88fd-995414081445 tempest-VolumesSnapshotTestJSON-118013990 None] Created volume successfully. Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-d8655747-95d9-49c4-be7c-77f94e47e159-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-d8655747-95d9-49c4-be7c-77f94e47e159-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-d8655747-95d9-49c4-be7c-77f94e47e159" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-d8655747-95d9-49c4-be7c-77f94e47e159" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d7eab9-de1e-4234-9cec-1881d4e1e6c1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:22 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 1073741824" returned: 0 in 0.468s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:22 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 Nov 02 10:14:22 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:22 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 Nov 02 10:14:22 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:23 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19917c3a-7a9e-4699-ad02-a669eb597208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdbf5fa-ea4f-4c67-b801-c7d1b148483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:23 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Volume volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 (9ba09c88-8e1a-4bb0-b25a-01bc3c172f43): created successfully Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdbf5fa-ea4f-4c67-b801-c7d1b148483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (c9a346c7-519e-4d20-ba6a-fc6129bf50da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-693399cc-c3cd-4273-99e5-0f7dcf8e8cf4 tempest-VolumesGetTest-1290979671 None] Created volume successfully. Nov 02 10:14:23 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159" returned: 0 in 0.383s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:23 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159 Nov 02 10:14:23 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:23 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d8655747-95d9-49c4-be7c-77f94e47e159" returned: 0 in 0.267s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-d8655747-95d9-49c4-be7c-77f94e47e159" released by "delete_volume" :: held 0.694s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['dfd86099-bf48-4b2f-a3b9-49138ac3c053', '50590c01-3db2-4b87-88b5-c6d794d82a55', 'ff19fa1d-b8d5-488a-9b24-91b8f72cfa74', '76649491-ce4f-4cec-9f4d-a147b320c760'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:23 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:23 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:23 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-e71d7ea6-449c-46dc-a63b-1cfd632cb10c-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.294s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Deleted volume successfully. Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-e71d7ea6-449c-46dc-a63b-1cfd632cb10c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-3f65ea32-ff80-405b-bbd7-325c461dc640" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-3f65ea32-ff80-405b-bbd7-325c461dc640" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-e71d7ea6-449c-46dc-a63b-1cfd632cb10c" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-62069935-b634-4b74-851c-8233d6cee1c9 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-d8655747-95d9-49c4-be7c-77f94e47e159-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-e71d7ea6-449c-46dc-a63b-1cfd632cb10c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Deleting offline snapshot e71d7ea6-449c-46dc-a63b-1cfd632cb10c of volume 3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] snapshot_file for this snap is: volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c765e284-dee0-48c6-b099-8578d4ecdf09]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:24 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c Nov 02 10:14:24 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:24 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f65ea32-ff80-405b-bbd7-325c461dc640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbaaa9-4de5-4bc5-8994-e8d3207d603d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:24 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 Nov 02 10:14:24 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (899cb320-a009-4710-80cc-ad490ebaec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f73fec3-cd67-4c72-838c-a7120ba92d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f73fec3-cd67-4c72-838c-a7120ba92d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-466785818',display_name='tempest-VolumesGetTest-Volume-1611559017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b7a8f0-89ad-4dfe-9732-60473a0a377a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:25Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4108e85e-e198-42b1-9352-8c2755dd45d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4108e85e-e198-42b1-9352-8c2755dd45d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3648af11-6c03-4905-8bbc-494900284797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3648af11-6c03-4905-8bbc-494900284797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b7a8f0-89ad-4dfe-9732-60473a0a377a', 'volume_name': 'volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da101dbe-a6ad-40ab-b58b-d290615e69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da101dbe-a6ad-40ab-b58b-d290615e69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466049a6-dffb-45e6-9953-26d8169378ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Volume 90b7a8f0-89ad-4dfe-9732-60473a0a377a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a', 'volume_size': 1} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-466785818',display_name='tempest-VolumesGetTest-Volume-1611559017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b7a8f0-89ad-4dfe-9732-60473a0a377a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:25Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Creating volume 90b7a8f0-89ad-4dfe-9732-60473a0a377a {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:24 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:24 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a 1073741824 Nov 02 10:14:24 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:24 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640" returned: 0 in 0.634s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:25 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c Nov 02 10:14:25 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:25 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a 1073741824" returned: 0 in 0.455s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:25 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a Nov 02 10:14:25 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:25 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c" returned: 0 in 0.373s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:25 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c Nov 02 10:14:25 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:25 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a" returned: 0 in 0.259s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466049a6-dffb-45e6-9953-26d8169378ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d123a6-33e0-4c7d-b3a2-8879489b1890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Volume volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a (90b7a8f0-89ad-4dfe-9732-60473a0a377a): created successfully Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d123a6-33e0-4c7d-b3a2-8879489b1890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (899cb320-a009-4710-80cc-ad490ebaec6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7f6546f9-34bf-452b-86e3-fc1ac91aa034 tempest-VolumesGetTest-1290979671 None] Created volume successfully. Nov 02 10:14:25 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640.e71d7ea6-449c-46dc-a63b-1cfd632cb10c" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-e71d7ea6-449c-46dc-a63b-1cfd632cb10c" released by "_delete_snapshot" :: held 1.783s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-3f65ea32-ff80-405b-bbd7-325c461dc640" released by "delete_snapshot" :: held 1.812s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['958b4035-34fc-4213-a5a2-1687381a4be1', '818323e6-9b20-4290-a1ce-c47c497f99c8', 'e7aeb964-e602-4717-b52a-f1ec4ef86553', '170333ae-3484-497f-9104-d673b2bb63eb'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Delete snapshot completed successfully. Nov 02 10:14:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ceca3786-0205-4188-a064-471fe59bd527 tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-e71d7ea6-449c-46dc-a63b-1cfd632cb10c-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-3f65ea32-ff80-405b-bbd7-325c461dc640-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-3f65ea32-ff80-405b-bbd7-325c461dc640-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-3f65ea32-ff80-405b-bbd7-325c461dc640" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-3f65ea32-ff80-405b-bbd7-325c461dc640" acquired by "delete_volume" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab5ca0-cd7d-4e86-b3ba-3b103791a9ba]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:26 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 Nov 02 10:14:26 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:26 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640" returned: 0 in 0.396s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:26 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640 Nov 02 10:14:26 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:26 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f65ea32-ff80-405b-bbd7-325c461dc640" returned: 0 in 0.320s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-90b7a8f0-89ad-4dfe-9732-60473a0a377a-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-3f65ea32-ff80-405b-bbd7-325c461dc640" released by "delete_volume" :: held 0.804s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Lock "cinder-90b7a8f0-89ad-4dfe-9732-60473a0a377a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-90b7a8f0-89ad-4dfe-9732-60473a0a377a" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['bc631b9c-7c08-42d6-b5e6-3aa3a356416c', 'fa57ceeb-c1dd-41e1-9e57-ee3a3e6019ee', 'fcd374d2-7191-4d70-957c-961030c8f4f4', 'd882ef45-ef94-403c-bb98-63660df96f0e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-90b7a8f0-89ad-4dfe-9732-60473a0a377a" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39c5a28-a06c-4b35-9cdf-f2f0748fdd91]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:27 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a Nov 02 10:14:27 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-a18ee036-e538-42e5-8e7b-52f6cfc86299-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-a18ee036-e538-42e5-8e7b-52f6cfc86299-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "cinder-quobyte-a18ee036-e538-42e5-8e7b-52f6cfc86299" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-a18ee036-e538-42e5-8e7b-52f6cfc86299" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:27 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.320s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Deleted volume successfully. Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd468653-74d4-4a0b-9592-db1c8f06b7b5]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a" returned: 0 in 0.446s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7572f9f-c398-4f6e-965e-762722f2897a tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-3f65ea32-ff80-405b-bbd7-325c461dc640-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:27 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a Nov 02 10:14:27 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 Nov 02 10:14:27 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-90b7a8f0-89ad-4dfe-9732-60473a0a377a" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-90b7a8f0-89ad-4dfe-9732-60473a0a377a" released by "delete_volume" :: held 0.756s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Created reservations ['74dd0daf-e66b-4bf6-9fc9-dc1d58da8e8a', '69daf8c3-5994-411a-b2a3-88c0add84e5e', 'e962157b-0a5c-4491-8fd8-dc1247e11e1a', 'c29a258f-51ed-4a8d-a61a-26095ebf072c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:27 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299 Nov 02 10:14:27 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:27 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:28 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a18ee036-e538-42e5-8e7b-52f6cfc86299" returned: 0 in 0.289s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-quobyte-a18ee036-e538-42e5-8e7b-52f6cfc86299" released by "delete_volume" :: held 0.776s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Lock "cinder-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:28 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.306s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Deleted volume successfully. Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d2cf869a-2a41-47b4-a6cf-f0578c7b0847 tempest-VolumesGetTest-1290979671 None] Lock "cinder-90b7a8f0-89ad-4dfe-9732-60473a0a377a-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Created reservations ['384d975e-39e3-4df5-87c4-dbd4f3243532', 'ac2a27fe-7e75-490e-915c-4fea20afc739', '7210e6d6-6b58-4da7-b3c0-a8d2321a1d9d', '1c4a6c90-42ff-414d-8a05-a6e158455288'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f6b28-9df9-43d5-9a32-4c6477e68046]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:28 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:28 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 Nov 02 10:14:28 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:28 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Deleted volume successfully. Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c79d5e-5578-458d-a9e7-f37a70c4880f tempest-VolumesSnapshotTestJSON-118013990 None] Lock "cinder-a18ee036-e538-42e5-8e7b-52f6cfc86299-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:28 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43" returned: 0 in 0.399s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43 Nov 02 10:14:28 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:29 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43" returned: 0 in 0.258s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43" released by "delete_volume" :: held 0.702s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Created reservations ['5db31453-62e5-476b-97c5-f8541073c608', 'eba56d0b-adde-455d-b580-b2bf5b757539', 'bca32021-05c3-4921-9793-763b7d2761de', '48e23cb7-d272-4e3d-915d-0ee9f6f6e993'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:29 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:29 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:29 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Deleted volume successfully. Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ff500c65-1515-45be-811b-50ba39c07b04 tempest-VolumesGetTest-1290979671 None] Lock "cinder-9ba09c88-8e1a-4bb0-b25a-01bc3c172f43-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (452c0880-52f0-4c74-b34e-2b60b34ab630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a515c4d5-d8ce-473f-a2dd-3cda29822518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a515c4d5-d8ce-473f-a2dd-3cda29822518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1980785425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd85985-79b2-461a-98e8-94d725ba17e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:30Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988f5c70-5479-4358-a260-5645565bb5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988f5c70-5479-4358-a260-5645565bb5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc7cfe4-a641-452d-9995-b86f70df67d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc7cfe4-a641-452d-9995-b86f70df67d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd85985-79b2-461a-98e8-94d725ba17e9', 'volume_name': 'volume-ebd85985-79b2-461a-98e8-94d725ba17e9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bad86d-2dc5-4b5b-b65c-03131e5ae754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bad86d-2dc5-4b5b-b65c-03131e5ae754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28de4d5-9980-45f5-92b0-c43d8999c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Volume ebd85985-79b2-461a-98e8-94d725ba17e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd85985-79b2-461a-98e8-94d725ba17e9', 'volume_size': 1} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1980785425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd85985-79b2-461a-98e8-94d725ba17e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:30Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Creating volume ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:29 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:14:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:30 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 1073741824 Nov 02 10:14:30 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:30 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 1073741824" returned: 0 in 0.499s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:30 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 Nov 02 10:14:30 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:30 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9" returned: 0 in 0.246s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28de4d5-9980-45f5-92b0-c43d8999c981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd85985-79b2-461a-98e8-94d725ba17e9', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d160da9e-1850-4ce1-bf10-9e274ef1ab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:30 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Volume volume-ebd85985-79b2-461a-98e8-94d725ba17e9 (ebd85985-79b2-461a-98e8-94d725ba17e9): created successfully Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d160da9e-1850-4ce1-bf10-9e274ef1ab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (452c0880-52f0-4c74-b34e-2b60b34ab630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-90eeb299-bced-4230-8298-1460f93acea9 tempest-VolumesGetTest-1290979671 None] Created volume successfully. Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (f7dba7c3-76b7-4ca6-a807-06ff829cb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48afc20-f3b3-4e56-b218-31b4d7d03a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48afc20-f3b3-4e56-b218-31b4d7d03a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1583454937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b175616-6fff-4049-a611-3abcf3b96bf2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ebd85985-79b2-461a-98e8-94d725ba17e9,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:33Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09468fe6-cc76-4032-8f51-3a67eecf455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09468fe6-cc76-4032-8f51-3a67eecf455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293006e4-720e-4ab6-befb-13096f0a7c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293006e4-720e-4ab6-befb-13096f0a7c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4b175616-6fff-4049-a611-3abcf3b96bf2', 'volume_name': 'volume-4b175616-6fff-4049-a611-3abcf3b96bf2', 'volume_size': 1, 'source_volid': 'ebd85985-79b2-461a-98e8-94d725ba17e9', 'source_volstatus': 'available'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfef22bd-e752-4555-b27d-dbc484956388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfef22bd-e752-4555-b27d-dbc484956388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31565216-5797-4164-bb29-dcdb9c49c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Volume 4b175616-6fff-4049-a611-3abcf3b96bf2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4b175616-6fff-4049-a611-3abcf3b96bf2', 'volume_size': 1, 'source_volid': 'ebd85985-79b2-461a-98e8-94d725ba17e9', 'source_volstatus': 'available'} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:32 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Cloning volume ebd85985-79b2-461a-98e8-94d725ba17e9 to volume 4b175616-6fff-4049-a611-3abcf3b96bf2 Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Creating offline snapshot 1bbb8c54-6390-4656-902c-181e302170b5 of volume ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85bbbb8-7762-4c1b-836b-0f8634a64be1]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:32 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 Nov 02 10:14:32 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:33 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9" returned: 0 in 0.404s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:33 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 1G Nov 02 10:14:33 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:33 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 1G" returned: 0 in 0.522s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd85985-79b2-461a-98e8-94d725ba17e9 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:33 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd85985-79b2-461a-98e8-94d725ba17e9 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 Nov 02 10:14:33 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd85985-79b2-461a-98e8-94d725ba17e9 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5" returned: 0 in 0.334s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 is being set with open permissions: ugo+rw Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 Nov 02 10:14:34 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5" returned: 0 in 0.261s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.info Nov 02 10:14:34 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.info" returned: 0 in 0.271s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.info is being set with open permissions: ugo+rw Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.info Nov 02 10:14:34 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.info" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-4b175616-6fff-4049-a611-3abcf3b96bf2" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-4b175616-6fff-4049-a611-3abcf3b96bf2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] snapshot: 1bbb8c54-6390-4656-902c-181e302170b5, volume: 4b175616-6fff-4049-a611-3abcf3b96bf2, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[de880b6c-da8f-4104-95a4-aa05eb0ab63e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:35 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 Nov 02 10:14:35 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:35 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5" returned: 0 in 0.414s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd85985-79b2-461a-98e8-94d725ba17e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d97daf-3afa-430d-a59f-84a953b50ee7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:35 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 Nov 02 10:14:35 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:35 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9" returned: 0 in 0.380s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:14:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:35 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 Nov 02 10:14:35 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:42 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2" returned: 0 in 6.654s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:42 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Converted 1024.00 MB image at 153.88 MB/s Nov 02 10:14:42 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 is being set with open permissions: ugo+rw Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:42 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 Nov 02 10:14:42 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:42 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2" returned: 0 in 0.275s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-4b175616-6fff-4049-a611-3abcf3b96bf2" released by "_copy_volume_from_snapshot" :: held 7.817s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=106,cinder:UPDATE=154,cinder:INSERT=37,cinder:DELETE=14 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-1bbb8c54-6390-4656-902c-181e302170b5" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-1bbb8c54-6390-4656-902c-181e302170b5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Deleting offline snapshot 1bbb8c54-6390-4656-902c-181e302170b5 of volume ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] snapshot_file for this snap is: volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289a961-27fa-401b-969d-2c24118cf48d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:42 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 Nov 02 10:14:42 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:43 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5" returned: 0 in 0.476s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd85985-79b2-461a-98e8-94d725ba17e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b769914e-282d-432a-8332-841631da9301]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:43 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 Nov 02 10:14:43 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:43 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9" returned: 0 in 0.598s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:43 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 Nov 02 10:14:43 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:DELETE=13,cinder:SELECT=123,cinder:INSERT=40,cinder:UPDATE=154 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:44 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5" returned: 0 in 0.406s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:44 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5 Nov 02 10:14:44 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:44 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9.1bbb8c54-6390-4656-902c-181e302170b5" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-1bbb8c54-6390-4656-902c-181e302170b5" released by "_delete_snapshot" :: held 1.898s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.973s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31565216-5797-4164-bb29-dcdb9c49c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b175616-6fff-4049-a611-3abcf3b96bf2', 'volume_size': 1, 'source_volid': 'ebd85985-79b2-461a-98e8-94d725ba17e9', 'source_volstatus': 'available'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85580b16-b33a-4e96-80b0-5e85b99ad06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:44 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Volume volume-4b175616-6fff-4049-a611-3abcf3b96bf2 (4b175616-6fff-4049-a611-3abcf3b96bf2): created successfully Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85580b16-b33a-4e96-80b0-5e85b99ad06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:44 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (f7dba7c3-76b7-4ca6-a807-06ff829cb091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:44 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5518271b-54bb-481c-b51d-3837c8f23499 tempest-VolumesGetTest-1290979671 None] Created volume successfully. Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (b156a050-e3e8-475e-921d-d9762d511452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fe592e-02f1-45a6-bf33-b85a9bd28ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fe592e-02f1-45a6-bf33-b85a9bd28ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1840061034',display_name='tempest-VolumesGetTest-Volume-1946159650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbff8e8-648b-4229-8e53-c46efc7d5253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:46Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52846d4d-16b8-406e-9f26-b8b0a75f17d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52846d4d-16b8-406e-9f26-b8b0a75f17d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7f784c-d492-4111-a5c6-aa9dfabb73f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7f784c-d492-4111-a5c6-aa9dfabb73f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbff8e8-648b-4229-8e53-c46efc7d5253', 'volume_name': 'volume-2bbff8e8-648b-4229-8e53-c46efc7d5253', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf653c3-b399-41c6-bb48-7640d10061fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf653c3-b399-41c6-bb48-7640d10061fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000adb51-0da1-499a-a0e9-91030aadb84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Volume 2bbff8e8-648b-4229-8e53-c46efc7d5253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbff8e8-648b-4229-8e53-c46efc7d5253', 'volume_size': 1} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1840061034',display_name='tempest-VolumesGetTest-Volume-1946159650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbff8e8-648b-4229-8e53-c46efc7d5253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:46Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Creating volume 2bbff8e8-648b-4229-8e53-c46efc7d5253 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:46 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:14:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:46 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 1073741824 Nov 02 10:14:46 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:47 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 1073741824" returned: 0 in 0.491s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:47 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 Nov 02 10:14:47 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:47 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253" returned: 0 in 0.287s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000adb51-0da1-499a-a0e9-91030aadb84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbff8e8-648b-4229-8e53-c46efc7d5253', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07b2b0e-70cf-44b1-916c-d785b619981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:47 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Volume volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 (2bbff8e8-648b-4229-8e53-c46efc7d5253): created successfully Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07b2b0e-70cf-44b1-916c-d785b619981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:47 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (b156a050-e3e8-475e-921d-d9762d511452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:47 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d2e1ef18-6d0b-4fad-84cc-6f2095728ccf tempest-VolumesGetTest-1290979671 None] Created volume successfully. Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-2bbff8e8-648b-4229-8e53-c46efc7d5253-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Lock "cinder-2bbff8e8-648b-4229-8e53-c46efc7d5253-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-2bbff8e8-648b-4229-8e53-c46efc7d5253" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-2bbff8e8-648b-4229-8e53-c46efc7d5253" acquired by "delete_volume" :: waited 0.038s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:48 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:48 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba9a42-0dd0-4d17-bcdb-63b2b55e0dd8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 Nov 02 10:14:49 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:49 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:14:49 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253" returned: 0 in 0.515s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253 Nov 02 10:14:49 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:49 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2bbff8e8-648b-4229-8e53-c46efc7d5253" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-2bbff8e8-648b-4229-8e53-c46efc7d5253" released by "delete_volume" :: held 0.858s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Created reservations ['e3e66a51-627a-4d5d-a589-f50a6b0c4077', '9acc3dfe-9943-4018-aad6-3410a579908e', '22f3938a-99f7-43ca-a69f-6f44f9c3fda6', '6955959a-b1b2-4e1f-8efb-26bce8a1594c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:49 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-4b175616-6fff-4049-a611-3abcf3b96bf2-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Lock "cinder-4b175616-6fff-4049-a611-3abcf3b96bf2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-4b175616-6fff-4049-a611-3abcf3b96bf2" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-4b175616-6fff-4049-a611-3abcf3b96bf2" acquired by "delete_volume" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d773c9d6-116a-4a29-8ca2-7125193bca6a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 Nov 02 10:14:50 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.398s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Deleted volume successfully. Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88ec42cb-be88-4da6-bfcb-8d40a6cd3276 tempest-VolumesGetTest-1290979671 None] Lock "cinder-2bbff8e8-648b-4229-8e53-c46efc7d5253-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:50 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2" returned: 0 in 0.422s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2 Nov 02 10:14:50 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4b175616-6fff-4049-a611-3abcf3b96bf2" returned: 0 in 0.282s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-4b175616-6fff-4049-a611-3abcf3b96bf2" released by "delete_volume" :: held 0.767s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:50 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Created reservations ['931ba7a4-cf84-44fe-8c0e-0efc309b5f13', '09037e2a-847c-4d9c-a5ca-38455e7440dc', '9327040a-646a-474f-a566-cdc3f5b677f6', 'd7650ba9-d4d7-4414-b90b-797e4686810b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:51 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-ebd85985-79b2-461a-98e8-94d725ba17e9-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Lock "cinder-ebd85985-79b2-461a-98e8-94d725ba17e9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:51 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.343s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-ebd85985-79b2-461a-98e8-94d725ba17e9" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Deleted volume successfully. Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-ebd85985-79b2-461a-98e8-94d725ba17e9" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56f5a375-e2f7-4e58-bd1d-b7c2cf4c8b4c tempest-VolumesGetTest-1290979671 None] Lock "cinder-4b175616-6fff-4049-a611-3abcf3b96bf2-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c50e4e-301a-4cc8-b308-1042d9337532]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 Nov 02 10:14:51 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9 Nov 02 10:14:51 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ebd85985-79b2-461a-98e8-94d725ba17e9" returned: 0 in 0.273s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-ebd85985-79b2-461a-98e8-94d725ba17e9" released by "delete_volume" :: held 0.728s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Created reservations ['8806b53a-e9a1-4724-b990-3a9d03acb165', 'efdbb631-3ee6-4c78-9f2b-a28b997e3f1c', '528b664e-0195-40f7-89c4-876354945c2c', '301419f7-036b-46e6-a53e-90cde1456f01'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:14:52 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.301s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Deleted volume successfully. Nov 02 10:14:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0065be25-b39c-468e-a6ef-165daded8a90 tempest-VolumesGetTest-1290979671 None] Lock "cinder-ebd85985-79b2-461a-98e8-94d725ba17e9-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (e28b705f-8a0d-42c2-822c-d6cac7ab1ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01fdbab-b6ae-4496-ba3a-7c07aa640b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01fdbab-b6ae-4496-ba3a-7c07aa640b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1348222277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cecab8-c079-465d-b7b0-4f3d3e165fbe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:53Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a09652-57d1-4e09-a540-9acd02933c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a09652-57d1-4e09-a540-9acd02933c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdeb75d-0b01-42e5-bb6f-98f0aeb50608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdeb75d-0b01-42e5-bb6f-98f0aeb50608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8cecab8-c079-465d-b7b0-4f3d3e165fbe', 'volume_name': 'volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d802ed99-2c60-40b2-ad68-fd64be1bfd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d802ed99-2c60-40b2-ad68-fd64be1bfd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7feb7040-2f20-430f-9f39-0889f379edb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:53 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Volume a8cecab8-c079-465d-b7b0-4f3d3e165fbe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:14:53 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Trying to clone a8cecab8-c079-465d-b7b0-4f3d3e165fbe from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:14:54 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:14:54 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:14:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd268a-b19c-45b7-98b7-00723e85ea1b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:54 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD Nov 02 10:14:54 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:54 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:54 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 is fetched for user 8f3407dc45a44f91bb4a778866f644be. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:14:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e3a4a3-b25e-4a69-aaf9-383c4ca1efb4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:54 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD Nov 02 10:14:54 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:55 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1348222277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cecab8-c079-465d-b7b0-4f3d3e165fbe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:53Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Creating volume a8cecab8-c079-465d-b7b0-4f3d3e165fbe {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:55 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:55 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe 1073741824 Nov 02 10:14:55 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:55 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe 1073741824" returned: 0 in 0.537s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:55 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe Nov 02 10:14:55 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:56 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe" returned: 0 in 0.353s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Attempting download of 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume a8cecab8-c079-465d-b7b0-4f3d3e165fbe. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[93690e39-c8e9-46d7-8eda-5ee02f7c495d]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_cue6e9_n {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:56 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_cue6e9_n Nov 02 10:14:56 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:56 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_cue6e9_n" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_cue6e9_n {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:56 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_cue6e9_n Nov 02 10:14:56 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:56 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_cue6e9_n" returned: 1 in 0.355s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e759a38-67b9-4ba7-b77d-917ff16305f2_cue6e9_n' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[400bef5d-6cd5-46ba-9eac-f6f1d30720ec]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:57 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD Nov 02 10:14:57 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:57 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:57 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] 4e759a38-67b9-4ba7-b77d-917ff16305f2 was qcow2, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:14:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:57 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe Nov 02 10:14:57 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:59 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe" returned: 0 in 2.410s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:59 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e759a38-67b9-4ba7-b77d-917ff16305f2__y4cens7devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:59 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Converted 112.00 MB image at 46.44 MB/s Nov 02 10:14:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:59 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe 1G Nov 02 10:14:59 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:00 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe 1G" returned: 0 in 0.408s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Downloaded image 4e759a38-67b9-4ba7-b77d-917ff16305f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}])) to volume a8cecab8-c079-465d-b7b0-4f3d3e165fbe successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Temporary image 4e759a38-67b9-4ba7-b77d-917ff16305f2 for user 8f3407dc45a44f91bb4a778866f644be is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Marking volume a8cecab8-c079-465d-b7b0-4f3d3e165fbe as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Copying metadata from image 4e759a38-67b9-4ba7-b77d-917ff16305f2 to a8cecab8-c079-465d-b7b0-4f3d3e165fbe. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Creating volume glance metadata for volume a8cecab8-c079-465d-b7b0-4f3d3e165fbe backed by image 4e759a38-67b9-4ba7-b77d-917ff16305f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7feb7040-2f20-430f-9f39-0889f379edb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe', 'volume_size': 1, 'image_id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e759a38-67b9-4ba7-b77d-917ff16305f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95296086d5b346e0baf8789d51ec8643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e759a38-67b9-4ba7-b77d-917ff16305f2', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e759a38-67b9-4ba7-b77d-917ff16305f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3567b37-0d0e-46c6-b877-1231b30985c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:00 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Volume volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe (a8cecab8-c079-465d-b7b0-4f3d3e165fbe): created successfully Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3567b37-0d0e-46c6-b877-1231b30985c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (e28b705f-8a0d-42c2-822c-d6cac7ab1ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fc97f68a-dcf6-4176-bec9-a5dbf58cfc81 tempest-VolumesGetTest-1290979671 None] Created volume successfully. Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Flow 'volume_create_manager' (28860db7-1f89-4692-884e-150eb67d21ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3e3d19-0664-45b0-b459-95592f114727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3e3d19-0664-45b0-b459-95592f114727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1349263109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d9c6b8-9144-4f21-8238-9775da1a5191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342deb71e9234a1c99f5142bffd61d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:01Z,use_quota=True,user_id='79d21e7015934439868b95df782d301a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cb140c-debe-400e-aa81-d3df2889ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cb140c-debe-400e-aa81-d3df2889ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c1a205-2542-4a5f-ae3e-55142aa2ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c1a205-2542-4a5f-ae3e-55142aa2ce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d9c6b8-9144-4f21-8238-9775da1a5191', 'volume_name': 'volume-e5d9c6b8-9144-4f21-8238-9775da1a5191', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0861caf-45b1-4ac3-868a-ad92223d1825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0861caf-45b1-4ac3-868a-ad92223d1825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da56793-c5a5-4b1f-9172-d7b405024f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:00 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Volume e5d9c6b8-9144-4f21-8238-9775da1a5191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d9c6b8-9144-4f21-8238-9775da1a5191', 'volume_size': 1} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1349263109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d9c6b8-9144-4f21-8238-9775da1a5191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342deb71e9234a1c99f5142bffd61d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:01Z,use_quota=True,user_id='79d21e7015934439868b95df782d301a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Creating volume e5d9c6b8-9144-4f21-8238-9775da1a5191 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:00 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:15:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:00 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 1073741824 Nov 02 10:15:00 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:01 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 1073741824" returned: 0 in 0.442s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:01 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 Nov 02 10:15:01 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (96569acf-4fb1-43bb-8ee8-1992a9014287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a929ca5-c4e8-485e-b205-1acce4ec585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a929ca5-c4e8-485e-b205-1acce4ec585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1374723212',display_name='tempest-VolumesGetTest-Volume-1886467088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cccd799-fa48-4c56-b2b5-1bbb40b70ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:02Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f6fe0-0bec-4692-9787-994346b29e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f6fe0-0bec-4692-9787-994346b29e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56ede83-fbfb-4e73-ba0a-32bc1e2cb9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56ede83-fbfb-4e73-ba0a-32bc1e2cb9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cccd799-fa48-4c56-b2b5-1bbb40b70ebc', 'volume_name': 'volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13999962-d165-43b8-bd8b-6ca1f20535df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13999962-d165-43b8-bd8b-6ca1f20535df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941ac45a-ecd8-4a37-8dc9-9809d2220d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Volume 5cccd799-fa48-4c56-b2b5-1bbb40b70ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc', 'volume_size': 1} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191" returned: 0 in 0.330s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1374723212',display_name='tempest-VolumesGetTest-Volume-1886467088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cccd799-fa48-4c56-b2b5-1bbb40b70ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9f9e80364d4eeaaaa719fe173d7de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:02Z,use_quota=True,user_id='8f3407dc45a44f91bb4a778866f644be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Creating volume 5cccd799-fa48-4c56-b2b5-1bbb40b70ebc {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:01 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:01 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc 1073741824 Nov 02 10:15:01 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da56793-c5a5-4b1f-9172-d7b405024f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d9c6b8-9144-4f21-8238-9775da1a5191', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385a1839-9d74-43fe-be29-80ed76b303f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Volume volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 (e5d9c6b8-9144-4f21-8238-9775da1a5191): created successfully Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385a1839-9d74-43fe-be29-80ed76b303f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Flow 'volume_create_manager' (28860db7-1f89-4692-884e-150eb67d21ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-94b11ea3-acae-44ed-aa1f-83dcafd9134e tempest-TestImageHashVerification-1415142318 None] Created volume successfully. Nov 02 10:15:02 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc 1073741824" returned: 0 in 0.486s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:02 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc Nov 02 10:15:02 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:02 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941ac45a-ecd8-4a37-8dc9-9809d2220d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617e2597-f021-4c3e-b4b2-2b401b0ac973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:02 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Volume volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc (5cccd799-fa48-4c56-b2b5-1bbb40b70ebc): created successfully Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617e2597-f021-4c3e-b4b2-2b401b0ac973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Flow 'volume_create_manager' (96569acf-4fb1-43bb-8ee8-1992a9014287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:02 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2dd3a77c-c317-459c-a360-834387ceb26b tempest-VolumesGetTest-1290979671 None] Created volume successfully. Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[028ae404-461c-4aa9-a6db-b65b33634c59]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Lock "cinder-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:03 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 Nov 02 10:15:03 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c05c997-ced7-47c3-b2c6-d0d415fe682c]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc Nov 02 10:15:04 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191" returned: 0 in 0.421s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e0b733-6a10-4b0f-819a-cf709d05d10b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc" returned: 0 in 0.398s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc Nov 02 10:15:04 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 Nov 02 10:15:04 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc" returned: 0 in 0.279s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc" released by "delete_volume" :: held 0.729s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:04 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191" returned: 0 in 0.408s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 /opt/stack/data/cinder/conversion/e5d9c6b8-9144-4f21-8238-9775da1a5191.temp_image.8da78be2-5991-4ed0-bceb-7a1a4de20a77nu_khkrf.img {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 /opt/stack/data/cinder/conversion/e5d9c6b8-9144-4f21-8238-9775da1a5191.temp_image.8da78be2-5991-4ed0-bceb-7a1a4de20a77nu_khkrf.img Nov 02 10:15:04 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Created reservations ['d54f9bb5-1579-4c3d-b450-03852f911264', 'a4c36266-edd0-4e6e-a9d4-f9cafcc187a0', '4b94bb4c-bc3f-451d-b244-aff8e276d1c8', '2c582a5c-ca33-46d3-bfba-484a22e6ae0b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:15:04 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-a8cecab8-c079-465d-b7b0-4f3d3e165fbe-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:05 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.394s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Deleted volume successfully. Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Lock "cinder-a8cecab8-c079-465d-b7b0-4f3d3e165fbe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc3d604a-60e3-454e-a965-d7e5f85b5d5a tempest-VolumesGetTest-1290979671 None] Lock "cinder-5cccd799-fa48-4c56-b2b5-1bbb40b70ebc-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Acquiring lock "cinder-quobyte-a8cecab8-c079-465d-b7b0-4f3d3e165fbe" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-a8cecab8-c079-465d-b7b0-4f3d3e165fbe" acquired by "delete_volume" :: waited 0.039s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b7b5b-23bf-483e-bc82-0f044bc42859]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:05 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe Nov 02 10:15:05 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:06 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe" returned: 0 in 0.567s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:06 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe Nov 02 10:15:06 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:06 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a8cecab8-c079-465d-b7b0-4f3d3e165fbe" returned: 0 in 0.349s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Lock "cinder-quobyte-a8cecab8-c079-465d-b7b0-4f3d3e165fbe" released by "delete_volume" :: held 0.999s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Created reservations ['23d15afa-e771-49a2-8160-a910b6c9684f', '93cb30bf-5f43-4d6c-b142-4eac078e8e95', '56aced93-6391-41e5-a41e-43ecad72a626', '8556644a-cb52-4f9c-875e-96e99bb6b62f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:06 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:15:06 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:07 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.386s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:07 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:07 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Deleted volume successfully. Nov 02 10:15:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f3c0c9e0-6be5-4f5a-ad30-4eb420d46da9 tempest-VolumesGetTest-1290979671 None] Lock "cinder-a8cecab8-c079-465d-b7b0-4f3d3e165fbe-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:11 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 /opt/stack/data/cinder/conversion/e5d9c6b8-9144-4f21-8238-9775da1a5191.temp_image.8da78be2-5991-4ed0-bceb-7a1a4de20a77nu_khkrf.img" returned: 0 in 6.463s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ec0d82-0dd0-40a7-882f-4b1e214d3d41]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:11 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 Nov 02 10:15:11 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:11 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191" returned: 0 in 0.521s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:11 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/conversion/e5d9c6b8-9144-4f21-8238-9775da1a5191.temp_image.8da78be2-5991-4ed0-bceb-7a1a4de20a77nu_khkrf.img {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:15:11 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Converted 1024.00 MB image at 158.42 MB/s Nov 02 10:15:11 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] 8da78be2-5991-4ed0-bceb-7a1a4de20a77 was raw, no need to convert to raw {{(pid=87005) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Flow 'volume_create_manager' (24620ff8-429e-4b58-b8a0-649092d0bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3fbda3-397a-47b3-aebf-c42322d24313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3fbda3-397a-47b3-aebf-c42322d24313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-465941269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19920cc9-9a24-47d1-8fee-116d524a07ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfd114e155e476eb334acf754c2e746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:13Z,use_quota=True,user_id='e426bd5c531746b488d21248e8dfa2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4e9a7f-cd76-41e4-aa22-4683f85ada02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4e9a7f-cd76-41e4-aa22-4683f85ada02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fa7619-c777-41fe-a40b-35b3f2042352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fa7619-c777-41fe-a40b-35b3f2042352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19920cc9-9a24-47d1-8fee-116d524a07ae', 'volume_name': 'volume-19920cc9-9a24-47d1-8fee-116d524a07ae', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a5b3f-64e7-4f54-9ad6-011ca1409716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a5b3f-64e7-4f54-9ad6-011ca1409716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec34dba-7244-4b2d-91a6-045a6615b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:13 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Volume 19920cc9-9a24-47d1-8fee-116d524a07ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19920cc9-9a24-47d1-8fee-116d524a07ae', 'volume_size': 1} Nov 02 10:15:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:23 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=45,cinder:UPDATE=50,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:15:23 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=64,cinder:SELECT=43,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.118s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Uploaded volume to glance image-id: 8da78be2-5991-4ed0-bceb-7a1a4de20a77. {{(pid=87005) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.662s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-465941269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19920cc9-9a24-47d1-8fee-116d524a07ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfd114e155e476eb334acf754c2e746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:13Z,use_quota=True,user_id='e426bd5c531746b488d21248e8dfa2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Creating volume 19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:30 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:15:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:30 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae 1073741824 Nov 02 10:15:30 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0f4a6a1d-bb4b-437c-9a82-32a2a9554c70 tempest-TestImageHashVerification-1415142318 None] Copy volume to image completed successfully. Nov 02 10:15:31 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae 1073741824" returned: 0 in 0.442s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:31 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae Nov 02 10:15:31 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:31 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae" returned: 0 in 0.231s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec34dba-7244-4b2d-91a6-045a6615b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19920cc9-9a24-47d1-8fee-116d524a07ae', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695e1bbc-9fc4-42c6-8689-c3d3fd2438e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:31 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Volume volume-19920cc9-9a24-47d1-8fee-116d524a07ae (19920cc9-9a24-47d1-8fee-116d524a07ae): created successfully Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695e1bbc-9fc4-42c6-8689-c3d3fd2438e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Flow 'volume_create_manager' (24620ff8-429e-4b58-b8a0-649092d0bee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-23c602fe-c1ad-4989-9848-c658e38bb8d0 tempest-VolumesSnapshotListTestJSON-1117275595 None] Created volume successfully. Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Acquiring lock "cinder-e5d9c6b8-9144-4f21-8238-9775da1a5191-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Lock "cinder-e5d9c6b8-9144-4f21-8238-9775da1a5191-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Acquiring lock "cinder-quobyte-e5d9c6b8-9144-4f21-8238-9775da1a5191" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Lock "cinder-quobyte-e5d9c6b8-9144-4f21-8238-9775da1a5191" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Creating offline snapshot 0aec8f7e-1ade-406a-958e-af8d743bd307 of volume 19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb4c5d-e378-4c03-a53d-5d0ed2e3be37]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c93bb-4c28-4937-baaf-328e5d7e2317]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:32 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae Nov 02 10:15:32 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:32 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 Nov 02 10:15:32 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:32 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae" returned: 0 in 0.359s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:32 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191" returned: 0 in 0.387s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:33 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 1G Nov 02 10:15:33 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:33 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191 Nov 02 10:15:33 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:33 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-e5d9c6b8-9144-4f21-8238-9775da1a5191" returned: 0 in 0.248s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Lock "cinder-quobyte-e5d9c6b8-9144-4f21-8238-9775da1a5191" released by "delete_volume" :: held 0.676s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Created reservations ['d1195134-6b45-4176-8119-cb12e15fe525', '08d76d5d-c766-4399-b6cd-a3921ec4194c', '902b435c-269a-475c-b744-8f0ac756c7b1', '09031d75-d915-44a4-9d22-817b7139a0e7'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:33 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 1G" returned: 0 in 0.437s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:33 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:15:33 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:33 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 Nov 02 10:15:33 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:33 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Deleted volume successfully. Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7d742929-b4af-47bb-a182-346e3827a57c tempest-TestImageHashVerification-1415142318 None] Lock "cinder-e5d9c6b8-9144-4f21-8238-9775da1a5191-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:33 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307" returned: 0 in 0.329s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:33 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 is being set with open permissions: ugo+rw Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:33 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 Nov 02 10:15:33 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:33 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307" returned: 0 in 0.240s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:34 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.info Nov 02 10:15:34 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:34 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.info" returned: 0 in 0.295s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:34 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.info is being set with open permissions: ugo+rw Nov 02 10:15:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:34 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.info Nov 02 10:15:34 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:34 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.info" returned: 0 in 0.307s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-223deaaf-064b-459b-b76c-717f9fd8963b tempest-VolumesSnapshotListTestJSON-1117275595 None] Create snapshot completed successfully Nov 02 10:15:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Creating offline snapshot ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 of volume 19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f033d-64b7-43fb-a900-db096c9db9f8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:36 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 Nov 02 10:15:36 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:36 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307" returned: 0 in 0.401s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19920cc9-9a24-47d1-8fee-116d524a07ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:36 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 1G Nov 02 10:15:36 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:36 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 1G" returned: 0 in 0.430s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:36 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 Nov 02 10:15:36 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" returned: 0 in 0.299s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 is being set with open permissions: ugo+rw Nov 02 10:15:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 Nov 02 10:15:37 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" returned: 0 in 0.300s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.555s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:37 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cc59239b-289b-4d7c-8bfa-88817e97ceba tempest-VolumesSnapshotListTestJSON-1117275595 None] Create snapshot completed successfully Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Creating offline snapshot cfefdb2d-701b-4438-a0de-b250bac4101c of volume 19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d969fe37-cfff-4db2-91f2-f77c75dfdb88]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:38 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 Nov 02 10:15:38 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:38 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19920cc9-9a24-47d1-8fee-116d524a07ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:38 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c 1G Nov 02 10:15:38 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:39 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c 1G" returned: 0 in 0.532s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:39 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c Nov 02 10:15:39 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:39 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c" returned: 0 in 0.322s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:39 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c is being set with open permissions: ugo+rw Nov 02 10:15:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:39 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c Nov 02 10:15:39 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:39 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c" returned: 0 in 0.236s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.608s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ced984c1-e37d-4b4c-87ae-538e91ede738 tempest-VolumesSnapshotListTestJSON-1117275595 None] Create snapshot completed successfully Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-cfefdb2d-701b-4438-a0de-b250bac4101c-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-cfefdb2d-701b-4438-a0de-b250bac4101c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-quobyte-cfefdb2d-701b-4438-a0de-b250bac4101c" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-cfefdb2d-701b-4438-a0de-b250bac4101c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Deleting offline snapshot cfefdb2d-701b-4438-a0de-b250bac4101c of volume 19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] snapshot_file for this snap is: volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb27baa-a84a-4b66-a7f6-fc671c8419a2]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:41 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c Nov 02 10:15:41 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:41 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c" returned: 0 in 0.376s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19920cc9-9a24-47d1-8fee-116d524a07ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc733e03-fa13-4c1a-9b10-408c321ccd94]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:41 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 Nov 02 10:15:41 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:42 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" returned: 0 in 0.430s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19920cc9-9a24-47d1-8fee-116d524a07ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:42 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c Nov 02 10:15:42 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:42 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c" returned: 0 in 0.469s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:42 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c Nov 02 10:15:42 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:42 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.cfefdb2d-701b-4438-a0de-b250bac4101c" returned: 0 in 0.284s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-cfefdb2d-701b-4438-a0de-b250bac4101c" released by "_delete_snapshot" :: held 1.671s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" released by "delete_snapshot" :: held 1.698s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Created reservations ['91b122f7-61cf-494f-829b-b26ea63124b6', '792c272e-1f38-499f-97a7-e4c4127912fe', 'd2272a0e-0beb-423b-aba6-ece821bab4f1', 'eb400b8e-0271-4aa6-a75d-8bb6598fde6b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:43 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Delete snapshot completed successfully. Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3e1caf89-f7eb-4912-a021-febf94eed2ee tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-cfefdb2d-701b-4438-a0de-b250bac4101c-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-quobyte-ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Deleting offline snapshot ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 of volume 19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] snapshot_file for this snap is: volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df57968-009b-44d1-95ab-672095a785cc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:43 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 Nov 02 10:15:43 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:43 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" returned: 0 in 0.387s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19920cc9-9a24-47d1-8fee-116d524a07ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09668a8-d9c0-4c70-8567-ebe42eae4f44]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:44 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 Nov 02 10:15:44 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:44 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307" returned: 0 in 0.407s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19920cc9-9a24-47d1-8fee-116d524a07ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:44 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 Nov 02 10:15:44 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:44 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" returned: 0 in 0.391s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:44 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51 Nov 02 10:15:44 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:44 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" returned: 0 in 0.257s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51" released by "_delete_snapshot" :: held 1.570s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" released by "delete_snapshot" :: held 1.597s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Created reservations ['0c958097-4c2c-4bf3-a68c-6927570443fd', '39c9f016-afaa-4628-a141-6d620cd204eb', 'dd53c6e6-151a-456b-9412-6dfeef97e724', 'f24dfc35-96ec-4a6d-adf4-360463c27605'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Delete snapshot completed successfully. Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9a1863d9-547a-4440-aa97-b2a020ecd2a9 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-ad6f5d1b-5f4b-49b2-b5db-c95bc0f4fc51-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-0aec8f7e-1ade-406a-958e-af8d743bd307-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-0aec8f7e-1ade-406a-958e-af8d743bd307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-quobyte-0aec8f7e-1ade-406a-958e-af8d743bd307" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-0aec8f7e-1ade-406a-958e-af8d743bd307" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Deleting offline snapshot 0aec8f7e-1ade-406a-958e-af8d743bd307 of volume 19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] snapshot_file for this snap is: volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6c4fc-e38a-4d33-89cb-dcad4079303a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:45 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 Nov 02 10:15:45 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:46 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307" returned: 0 in 0.390s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19920cc9-9a24-47d1-8fee-116d524a07ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85ade5-9254-4fbe-899c-545f960e9709]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:46 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae Nov 02 10:15:46 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:46 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae" returned: 0 in 0.409s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:46 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 Nov 02 10:15:46 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:46 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307" returned: 0 in 0.396s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:46 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307 Nov 02 10:15:46 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:47 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae.0aec8f7e-1ade-406a-958e-af8d743bd307" returned: 0 in 0.296s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-0aec8f7e-1ade-406a-958e-af8d743bd307" released by "_delete_snapshot" :: held 1.628s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" released by "delete_snapshot" :: held 1.656s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Created reservations ['14c57241-78b8-4c52-859b-360214cfdc63', '41c101ed-09b3-4955-966c-f0810ee7e0a6', '4da30205-bb14-467f-9a0e-bf676a1fc232', '9cc9add8-0457-4613-8394-70ecce667ee1'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:47 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Delete snapshot completed successfully. Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ea571fef-4cfe-4619-b714-8a986081cdea tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-0aec8f7e-1ade-406a-958e-af8d743bd307-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-19920cc9-9a24-47d1-8fee-116d524a07ae-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-19920cc9-9a24-47d1-8fee-116d524a07ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf55f94-39e6-40c1-8c81-5d20a352eef9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae Nov 02 10:15:48 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:48 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae" returned: 0 in 0.414s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae Nov 02 10:15:48 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:48 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-19920cc9-9a24-47d1-8fee-116d524a07ae" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-quobyte-19920cc9-9a24-47d1-8fee-116d524a07ae" released by "delete_volume" :: held 0.752s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Created reservations ['ec62e5ef-f1e0-40d9-a990-5b2057271d7d', 'a22852e2-2fb1-4193-83fc-6dedcbf54ec5', '2e04e988-2560-46a6-9d93-f6f2614f6fa2', '7ff34496-e3d0-4b0a-a13e-d887b52fe745'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:15:48 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:48 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:15:48 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:49 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.307s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:49 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Deleted volume successfully. Nov 02 10:15:49 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.314s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:15:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e8d403a-8c9c-4a81-abb9-9747c1794474 tempest-VolumesSnapshotListTestJSON-1117275595 None] Lock "cinder-19920cc9-9a24-47d1-8fee-116d524a07ae-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:58 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=32,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:15:59 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=38,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Flow 'volume_create_manager' (45c25583-7967-4f86-a2b0-bf618cbbba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b378988-a228-434b-acc2-9da828b890ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b378988-a228-434b-acc2-9da828b890ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-891636153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5693f66f-ace0-45a8-82a2-86c8a3a0ca36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867d948e728494583ccc2ff56781ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:18Z,use_quota=True,user_id='210bfe13a10045c596041d85fcdf0d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c9b794-5734-4521-b863-861fefac2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c9b794-5734-4521-b863-861fefac2882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1484fcc6-35cf-4a2c-80ac-e7efe6c1099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1484fcc6-35cf-4a2c-80ac-e7efe6c1099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5693f66f-ace0-45a8-82a2-86c8a3a0ca36', 'volume_name': 'volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4278e7f-c2b5-4289-8c3e-c51eb81be9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4278e7f-c2b5-4289-8c3e-c51eb81be9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a234442-514c-4952-a758-54e7019d08b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Volume 5693f66f-ace0-45a8-82a2-86c8a3a0ca36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36', 'volume_size': 1} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-891636153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5693f66f-ace0-45a8-82a2-86c8a3a0ca36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867d948e728494583ccc2ff56781ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:18Z,use_quota=True,user_id='210bfe13a10045c596041d85fcdf0d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Creating volume 5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:18 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:16:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:18 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 1073741824 Nov 02 10:16:18 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:19 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 1073741824" returned: 0 in 0.520s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:19 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 Nov 02 10:16:19 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:19 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" returned: 0 in 0.309s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a234442-514c-4952-a758-54e7019d08b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42f4c0c-001c-4f02-bdc1-26635c13b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Volume volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 (5693f66f-ace0-45a8-82a2-86c8a3a0ca36): created successfully Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42f4c0c-001c-4f02-bdc1-26635c13b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Flow 'volume_create_manager' (45c25583-7967-4f86-a2b0-bf618cbbba86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fad566aa-b106-4b40-bd1e-e456d7302776 tempest-TestStampPattern-408482898 None] Created volume successfully. Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Flow 'volume_create_manager' (34a58246-2031-42c5-bb7a-0e32fa7a7c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc50b15a-6054-42e0-a330-c29cc438956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc50b15a-6054-42e0-a330-c29cc438956b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-674910360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9667036c-6b5b-410c-a3c7-9ff369ca14d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17abd16453f4f71a04bb8895d43a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:21Z,use_quota=True,user_id='0a4bdf832ec042e4b64fb3ac880fd303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32285414-1921-4410-abe0-3e5853382eaf),volume_type_id=32285414-1921-4410-abe0-3e5853382eaf)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9568bee-9cf9-4761-bc74-bf50f6316ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9568bee-9cf9-4761-bc74-bf50f6316ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a17345-fbdc-47a1-9dd9-9bd8d93e0673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a17345-fbdc-47a1-9dd9-9bd8d93e0673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9667036c-6b5b-410c-a3c7-9ff369ca14d7', 'volume_name': 'volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0a8800-0904-46d1-8659-ac3923fcdf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0a8800-0904-46d1-8659-ac3923fcdf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b78778-d071-46f9-a9f3-47c74aa5e62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Volume 9667036c-6b5b-410c-a3c7-9ff369ca14d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7', 'volume_size': 1} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-674910360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9667036c-6b5b-410c-a3c7-9ff369ca14d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17abd16453f4f71a04bb8895d43a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:21Z,use_quota=True,user_id='0a4bdf832ec042e4b64fb3ac880fd303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32285414-1921-4410-abe0-3e5853382eaf),volume_type_id=32285414-1921-4410-abe0-3e5853382eaf)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Creating volume 9667036c-6b5b-410c-a3c7-9ff369ca14d7 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:21 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:16:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:21 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 1073741824 Nov 02 10:16:21 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Flow 'volume_create_manager' (ef0da6f1-446c-4ddd-b96d-4f9511ddc1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acf163a-9d9f-4184-805b-cf0d0e547840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acf163a-9d9f-4184-805b-cf0d0e547840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1463691633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e0efc9-5482-439a-91a7-74ccaf6f1009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17abd16453f4f71a04bb8895d43a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:22Z,use_quota=True,user_id='0a4bdf832ec042e4b64fb3ac880fd303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(798af038-08d6-4fa7-98a4-ee342a848511),volume_type_id=798af038-08d6-4fa7-98a4-ee342a848511)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe1f847-5691-4df5-be84-a210f9b0f23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe1f847-5691-4df5-be84-a210f9b0f23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8254bcf4-03fe-4ac3-901e-e0f27ad5399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8254bcf4-03fe-4ac3-901e-e0f27ad5399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e0efc9-5482-439a-91a7-74ccaf6f1009', 'volume_name': 'volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1145b8c9-3891-4794-9a34-ebd7ec030766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1145b8c9-3891-4794-9a34-ebd7ec030766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2915edd6-7d7b-41b4-9093-97ff85f88534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Volume c0e0efc9-5482-439a-91a7-74ccaf6f1009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009', 'volume_size': 1} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:22 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 1073741824" returned: 0 in 0.758s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 Nov 02 10:16:22 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7" returned: 0 in 0.304s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1463691633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e0efc9-5482-439a-91a7-74ccaf6f1009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17abd16453f4f71a04bb8895d43a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:22Z,use_quota=True,user_id='0a4bdf832ec042e4b64fb3ac880fd303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(798af038-08d6-4fa7-98a4-ee342a848511),volume_type_id=798af038-08d6-4fa7-98a4-ee342a848511)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Creating volume c0e0efc9-5482-439a-91a7-74ccaf6f1009 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:22 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b78778-d071-46f9-a9f3-47c74aa5e62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1706a878-51ba-4c41-b767-23f98d4c344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:22 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 1073741824 Nov 02 10:16:22 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Volume volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 (9667036c-6b5b-410c-a3c7-9ff369ca14d7): created successfully Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1706a878-51ba-4c41-b767-23f98d4c344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Flow 'volume_create_manager' (34a58246-2031-42c5-bb7a-0e32fa7a7c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0ab66797-31e2-41b6-8cbb-e9a8b41e59a3 tempest-TestInstancesWithCinderVolumes-891678405 None] Created volume successfully. Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Flow 'volume_create_manager' (63780feb-25a2-46b0-93ed-b0ed051c409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338e78af-346a-4e6a-b2ab-249a96f5051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338e78af-346a-4e6a-b2ab-249a96f5051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1167906939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74beaec8-0677-4edb-8e2b-54db2fa7bdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17abd16453f4f71a04bb8895d43a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:23Z,use_quota=True,user_id='0a4bdf832ec042e4b64fb3ac880fd303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91ed0278-2468-4b4c-93b0-0eaaaa028109),volume_type_id=91ed0278-2468-4b4c-93b0-0eaaaa028109)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cacce7b-37d5-4bf0-870c-c1b763eb4178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cacce7b-37d5-4bf0-870c-c1b763eb4178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad96245-61f2-4c3a-a294-5702b610494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad96245-61f2-4c3a-a294-5702b610494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74beaec8-0677-4edb-8e2b-54db2fa7bdac', 'volume_name': 'volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac', 'volume_size': 1, 'image_id': '4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2125164546', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b17abd16453f4f71a04bb8895d43a13d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'created_at': datetime.datetime(2026, 11, 2, 9, 16, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7/file', 'properties': {}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf4d8ef-86c1-4116-81e0-0892ea964f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf4d8ef-86c1-4116-81e0-0892ea964f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664b089e-166a-47aa-98e0-a7e9066229b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Volume 74beaec8-0677-4edb-8e2b-54db2fa7bdac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac', 'volume_size': 1, 'image_id': '4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2125164546', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b17abd16453f4f71a04bb8895d43a13d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'created_at': datetime.datetime(2026, 11, 2, 9, 16, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7/file', 'properties': {}}, 'image_service': } Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Trying to clone 74beaec8-0677-4edb-8e2b-54db2fa7bdac from image 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 1073741824" returned: 0 in 0.630s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:23 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 Nov 02 10:16:23 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:23 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009" returned: 0 in 0.304s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2915edd6-7d7b-41b4-9093-97ff85f88534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbcd472-45f9-4ab3-a7ad-cbb2e481c77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Volume volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 (c0e0efc9-5482-439a-91a7-74ccaf6f1009): created successfully Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbcd472-45f9-4ab3-a7ad-cbb2e481c77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Flow 'volume_create_manager' (ef0da6f1-446c-4ddd-b96d-4f9511ddc1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-45b455bf-21fc-443d-810f-8373f49c327a tempest-TestInstancesWithCinderVolumes-891678405 None] Created volume successfully. Nov 02 10:16:27 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD, size 20.69 MB, duration 4.31 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:16:27 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Image download 20.69 MB at 4.80 MB/s Nov 02 10:16:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf297b9-f4cf-4521-a617-4290e3e43273]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:27 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD Nov 02 10:16:27 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Temporary image 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 is fetched for user 0a4bdf832ec042e4b64fb3ac880fd303. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[12828c5e-6ea6-4189-86e7-694c2b347044]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD Nov 02 10:16:28 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1167906939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74beaec8-0677-4edb-8e2b-54db2fa7bdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17abd16453f4f71a04bb8895d43a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:23Z,use_quota=True,user_id='0a4bdf832ec042e4b64fb3ac880fd303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91ed0278-2468-4b4c-93b0-0eaaaa028109),volume_type_id=91ed0278-2468-4b4c-93b0-0eaaaa028109)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Creating volume 74beaec8-0677-4edb-8e2b-54db2fa7bdac {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:28 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:16:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac 1073741824 Nov 02 10:16:28 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac 1073741824" returned: 0 in 0.515s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:29 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac Nov 02 10:16:29 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac" returned: 0 in 0.242s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Attempting download of 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'metadata': {}}])) to volume 74beaec8-0677-4edb-8e2b-54db2fa7bdac. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a112270-4443-4de0-80ba-0aa5ff6f2282]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_z_hwle1w {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:29 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_z_hwle1w Nov 02 10:16:29 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_z_hwle1w" returned: 0 in 0.407s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_z_hwle1w {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:30 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_z_hwle1w Nov 02 10:16:30 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:30 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_z_hwle1w" returned: 1 in 0.401s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_z_hwle1w' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:16:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[516775b3-b318-4753-934d-d95af81034b4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:30 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD Nov 02 10:16:30 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:30 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 was qcow2, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:16:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:30 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac Nov 02 10:16:30 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:32 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac" returned: 0 in 1.837s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7_pakm7mqhdevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:16:32 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Converted 112.00 MB image at 60.93 MB/s Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:32 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac 1G Nov 02 10:16:32 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:32 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac 1G" returned: 0 in 0.320s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Downloaded image 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'metadata': {}}])) to volume 74beaec8-0677-4edb-8e2b-54db2fa7bdac successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Temporary image 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 for user 0a4bdf832ec042e4b64fb3ac880fd303 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Marking volume 74beaec8-0677-4edb-8e2b-54db2fa7bdac as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Copying metadata from image 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 to 74beaec8-0677-4edb-8e2b-54db2fa7bdac. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:16:32 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Creating volume glance metadata for volume 74beaec8-0677-4edb-8e2b-54db2fa7bdac backed by image 4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7 with: {'image_id': '4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'image_name': 'tempest-scenario-img--2125164546', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:16:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664b089e-166a-47aa-98e0-a7e9066229b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac', 'volume_size': 1, 'image_id': '4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2125164546', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b17abd16453f4f71a04bb8895d43a13d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7', 'created_at': datetime.datetime(2026, 11, 2, 9, 16, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbf9377-91f7-47f8-b7f6-6b0882fc5ca7/file', 'properties': {}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8a3e64-5971-4d0e-b3da-b8ee8fd9d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:33 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Volume volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac (74beaec8-0677-4edb-8e2b-54db2fa7bdac): created successfully Nov 02 10:16:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8a3e64-5971-4d0e-b3da-b8ee8fd9d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Flow 'volume_create_manager' (63780feb-25a2-46b0-93ed-b0ed051c409f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-aedf0dae-a283-4174-9ac4-0f7119414461 tempest-TestInstancesWithCinderVolumes-891678405 None] Created volume successfully. Nov 02 10:16:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-a52c7d5c-bd3d-4e3e-98fb-6f29a83b7a07 req-c194fd37-a66b-4095-b3c6-9a218a3e3745 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-a52c7d5c-bd3d-4e3e-98fb-6f29a83b7a07 req-c194fd37-a66b-4095-b3c6-9a218a3e3745 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-a52c7d5c-bd3d-4e3e-98fb-6f29a83b7a07 req-c194fd37-a66b-4095-b3c6-9a218a3e3745 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-a52c7d5c-bd3d-4e3e-98fb-6f29a83b7a07 req-c194fd37-a66b-4095-b3c6-9a218a3e3745 tempest-TestInstancesWithCinderVolumes-891678405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec445329-c95d-440e-a7a0-6160f2fabc75', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:16:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-a52c7d5c-bd3d-4e3e-98fb-6f29a83b7a07 req-c194fd37-a66b-4095-b3c6-9a218a3e3745 tempest-TestInstancesWithCinderVolumes-891678405 None] attachment_update completed successfully. Nov 02 10:16:46 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=27,cinder:UPDATE=11,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:16:46 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=19,cinder:SELECT=13,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:16:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:16:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:48 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:16:48 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:49 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:16:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:16:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:16:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-f83c5c56-c2e4-4f78-8df7-be1404d20f70 req-5a9b70bf-ac4c-4dc5-866d-05ce9f60976c tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-f83c5c56-c2e4-4f78-8df7-be1404d20f70 req-5a9b70bf-ac4c-4dc5-866d-05ce9f60976c tempest-TestStampPattern-408482898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-f83c5c56-c2e4-4f78-8df7-be1404d20f70 req-5a9b70bf-ac4c-4dc5-866d-05ce9f60976c tempest-TestStampPattern-408482898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-f83c5c56-c2e4-4f78-8df7-be1404d20f70 req-5a9b70bf-ac4c-4dc5-866d-05ce9f60976c tempest-TestStampPattern-408482898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baba3b7d-49dd-4261-84f2-661921b4e0cb', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:16:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-f83c5c56-c2e4-4f78-8df7-be1404d20f70 req-5a9b70bf-ac4c-4dc5-866d-05ce9f60976c tempest-TestStampPattern-408482898 None] attachment_update completed successfully. Nov 02 10:16:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-32118913-b5f9-4e8a-b127-9441ef62b310 req-92b58061-e31a-48e7-af2c-232ee2bb7bf1 tempest-TestStampPattern-408482898 None] Terminate volume connection completed successfully. Nov 02 10:16:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-32118913-b5f9-4e8a-b127-9441ef62b310 req-92b58061-e31a-48e7-af2c-232ee2bb7bf1 tempest-TestStampPattern-408482898 None] Deleting attachment baba3b7d-49dd-4261-84f2-661921b4e0cb. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:16:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Creating offline snapshot 3ce86736-850a-4153-9f7d-bbb3310a1c52 of volume 5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b7aee8-6d4a-4e9e-9213-2691c14477ac]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:56 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 Nov 02 10:16:56 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:56 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" returned: 0 in 0.400s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:56 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 1G Nov 02 10:16:56 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:57 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 1G" returned: 0 in 0.460s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:57 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 Nov 02 10:16:57 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:57 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52" returned: 0 in 0.354s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:57 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 is being set with open permissions: ugo+rw Nov 02 10:16:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:57 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 Nov 02 10:16:57 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:57 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52" returned: 0 in 0.273s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:57 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.info Nov 02 10:16:58 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:58 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.info" returned: 0 in 0.240s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.info is being set with open permissions: ugo+rw Nov 02 10:16:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:58 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.info Nov 02 10:16:58 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:58 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.info" returned: 0 in 0.248s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:58 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d6982f65-5ea7-429d-802e-23f4e1bf8375 tempest-TestStampPattern-408482898 None] Create snapshot completed successfully Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Flow 'volume_create_manager' (916933e6-edd3-4c1b-ada2-a4dca360df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061d92f9-6cdc-43b3-abe3-2b3aabb8e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061d92f9-6cdc-43b3-abe3-2b3aabb8e973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1390262367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e2d47b-e5ae-4ac1-8b66-6523be53f87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7867d948e728494583ccc2ff56781ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ce86736-850a-4153-9f7d-bbb3310a1c52,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:06Z,use_quota=True,user_id='210bfe13a10045c596041d85fcdf0d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e26b3b5-818c-45c7-ace0-4d9367895cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e26b3b5-818c-45c7-ace0-4d9367895cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1023da3-47e1-4373-bf90-842ebb82fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1023da3-47e1-4373-bf90-842ebb82fd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17e2d47b-e5ae-4ac1-8b66-6523be53f87d', 'volume_name': 'volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d', 'volume_size': 1, 'snapshot_id': '3ce86736-850a-4153-9f7d-bbb3310a1c52'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a3d37-b95f-48cf-b8c3-eadd1661311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a3d37-b95f-48cf-b8c3-eadd1661311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a27f82-81f5-4390-8f4e-5fc6beb44cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:06 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Volume 17e2d47b-e5ae-4ac1-8b66-6523be53f87d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d', 'volume_size': 1, 'snapshot_id': '3ce86736-850a-4153-9f7d-bbb3310a1c52'} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-quobyte-3ce86736-850a-4153-9f7d-bbb3310a1c52-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-3ce86736-850a-4153-9f7d-bbb3310a1c52-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Creating volume 17e2d47b-e5ae-4ac1-8b66-6523be53f87d from snapshot 3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-quobyte-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] snapshot: 3ce86736-850a-4153-9f7d-bbb3310a1c52, volume: 17e2d47b-e5ae-4ac1-8b66-6523be53f87d, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4165c8b-87f7-49fa-8c4b-10b38b60fc87]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:06 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 Nov 02 10:17:06 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:06 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52" returned: 0 in 0.392s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[135453a3-d438-464e-8fa1-f50162cc149b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:06 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 Nov 02 10:17:06 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:07 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" returned: 0 in 0.380s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:17:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:17:07 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:17:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:07 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d Nov 02 10:17:07 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-8674d3d0-b70c-41c7-91d9-1d232435a346 req-87cc2fbf-ff29-4b4b-b98d-a7bbb4948701 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:16 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" returned: 0 in 9.017s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36, size 1024.00 MB, duration 9.02 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:17:16 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Converted 1024.00 MB image at 113.54 MB/s Nov 02 10:17:16 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d is being set with open permissions: ugo+rw Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:16 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d Nov 02 10:17:16 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:16 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" returned: 0 in 0.338s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" released by "_copy_volume_from_snapshot" :: held 10.228s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-3ce86736-850a-4153-9f7d-bbb3310a1c52-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" released by "_create_volume_from_snapshot" :: held 10.294s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.310s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-8674d3d0-b70c-41c7-91d9-1d232435a346 req-87cc2fbf-ff29-4b4b-b98d-a7bbb4948701 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.690s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-8674d3d0-b70c-41c7-91d9-1d232435a346 req-87cc2fbf-ff29-4b4b-b98d-a7bbb4948701 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a27f82-81f5-4390-8f4e-5fc6beb44cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d', 'volume_size': 1, 'snapshot_id': '3ce86736-850a-4153-9f7d-bbb3310a1c52'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c19c9a-f351-4343-8afc-6ba3446b47c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:16 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Volume volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d (17e2d47b-e5ae-4ac1-8b66-6523be53f87d): created successfully Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c19c9a-f351-4343-8afc-6ba3446b47c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Flow 'volume_create_manager' (916933e6-edd3-4c1b-ada2-a4dca360df6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:16 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-8674d3d0-b70c-41c7-91d9-1d232435a346 req-87cc2fbf-ff29-4b4b-b98d-a7bbb4948701 tempest-TestInstancesWithCinderVolumes-891678405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5b20d85-ed68-4c73-8b79-cf033fb8a897', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:17:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d0906742-2c5b-4de0-bc3c-50fdaa4e179f tempest-TestStampPattern-408482898 None] Created volume successfully. Nov 02 10:17:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-8674d3d0-b70c-41c7-91d9-1d232435a346 req-87cc2fbf-ff29-4b4b-b98d-a7bbb4948701 tempest-TestInstancesWithCinderVolumes-891678405 None] attachment_update completed successfully. Nov 02 10:17:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0b832516-d9d2-4a0a-8aad-5f1f73cb2341 req-41abc6ae-bf1d-4e2f-9c96-bb58edb8ad46 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0b832516-d9d2-4a0a-8aad-5f1f73cb2341 req-41abc6ae-bf1d-4e2f-9c96-bb58edb8ad46 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-0b832516-d9d2-4a0a-8aad-5f1f73cb2341 req-41abc6ae-bf1d-4e2f-9c96-bb58edb8ad46 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0b832516-d9d2-4a0a-8aad-5f1f73cb2341 req-41abc6ae-bf1d-4e2f-9c96-bb58edb8ad46 tempest-TestInstancesWithCinderVolumes-891678405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '445aa015-686e-4ca0-9c11-31040cc96884', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:17:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-0b832516-d9d2-4a0a-8aad-5f1f73cb2341 req-41abc6ae-bf1d-4e2f-9c96-bb58edb8ad46 tempest-TestInstancesWithCinderVolumes-891678405 None] attachment_update completed successfully. Nov 02 10:17:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-2eb624b9-e377-411a-b1ad-0dad43e47656 req-842c1c44-75db-4659-afba-bcb11d6bbe4e tempest-TestInstancesWithCinderVolumes-891678405 None] Terminate volume connection completed successfully. Nov 02 10:17:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-2eb624b9-e377-411a-b1ad-0dad43e47656 req-842c1c44-75db-4659-afba-bcb11d6bbe4e tempest-TestInstancesWithCinderVolumes-891678405 None] Deleting attachment a5b20d85-ed68-4c73-8b79-cf033fb8a897. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:17:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "cinder-9667036c-6b5b-410c-a3c7-9ff369ca14d7-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-9667036c-6b5b-410c-a3c7-9ff369ca14d7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "cinder-quobyte-9667036c-6b5b-410c-a3c7-9ff369ca14d7" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-quobyte-9667036c-6b5b-410c-a3c7-9ff369ca14d7" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[da33dbe1-034c-42f5-8d73-3426b2c64d70]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:25 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 Nov 02 10:17:25 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:26 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7" returned: 0 in 0.432s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:26 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7 Nov 02 10:17:26 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:26 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9667036c-6b5b-410c-a3c7-9ff369ca14d7" returned: 0 in 0.281s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-quobyte-9667036c-6b5b-410c-a3c7-9ff369ca14d7" released by "delete_volume" :: held 0.762s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:26 devstack cinder-volume[87005]: WARNING cinder.quota [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-924510812-1093725331 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-924510812-1093725331, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:26 devstack cinder-volume[87005]: WARNING cinder.quota [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-924510812-1093725331 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-924510812-1093725331, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Created reservations ['146835e2-ba49-492e-a5ad-61d98650feea', '88c1e6e3-6589-4097-8ea3-e8edb3658435', '9f59c66e-69ec-425e-b963-3705a306200d', '4fd0cad4-50f8-4f18-bcf3-75c39dae240c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:26 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:26 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:26 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.250s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:26 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Deleted volume successfully. Nov 02 10:17:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-cc6d4d82-0d75-4c1b-aac2-06e16cbde5c7 tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-9667036c-6b5b-410c-a3c7-9ff369ca14d7-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-0c10c0ce-7323-48bf-bb21-ea2537592e72 req-65fa6630-c4f3-4a35-8333-8e368c130ec3 tempest-TestInstancesWithCinderVolumes-891678405 None] Terminate volume connection completed successfully. Nov 02 10:17:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-0c10c0ce-7323-48bf-bb21-ea2537592e72 req-65fa6630-c4f3-4a35-8333-8e368c130ec3 tempest-TestInstancesWithCinderVolumes-891678405 None] Deleting attachment 445aa015-686e-4ca0-9c11-31040cc96884. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "cinder-c0e0efc9-5482-439a-91a7-74ccaf6f1009-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-c0e0efc9-5482-439a-91a7-74ccaf6f1009-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "cinder-quobyte-c0e0efc9-5482-439a-91a7-74ccaf6f1009" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-quobyte-c0e0efc9-5482-439a-91a7-74ccaf6f1009" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d935dc0-b11b-4ec8-a864-9b2e5fd80c01]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:30 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 Nov 02 10:17:30 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:30 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009" returned: 0 in 0.374s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:30 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009 Nov 02 10:17:30 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:31 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c0e0efc9-5482-439a-91a7-74ccaf6f1009" returned: 0 in 0.250s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-quobyte-c0e0efc9-5482-439a-91a7-74ccaf6f1009" released by "delete_volume" :: held 0.675s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:31 devstack cinder-volume[87005]: WARNING cinder.quota [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1791034536-1855796507 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1791034536-1855796507, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:31 devstack cinder-volume[87005]: WARNING cinder.quota [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1791034536-1855796507 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1791034536-1855796507, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Created reservations ['58b85898-28f2-4cb8-b790-68ebbb3a8f41', 'c8120335-bbcc-494e-a9d2-ef60f99c123f', '5af89c22-fa52-4528-9de9-41493227ee05', '07005b9a-5d17-46da-91b8-859f2f152572'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:31 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:31 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:31 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.262s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Deleted volume successfully. Nov 02 10:17:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7101ccde-186f-4318-8ce9-530b1a5788cf tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-c0e0efc9-5482-439a-91a7-74ccaf6f1009-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-f16a0910-c4e7-4506-b608-7994c0866464 req-53bb9231-238c-4d1e-913f-a2ecf38eab74 tempest-TestInstancesWithCinderVolumes-891678405 None] Terminate volume connection completed successfully. Nov 02 10:17:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-f16a0910-c4e7-4506-b608-7994c0866464 req-53bb9231-238c-4d1e-913f-a2ecf38eab74 tempest-TestInstancesWithCinderVolumes-891678405 None] Deleting attachment ec445329-c95d-440e-a7a0-6160f2fabc75. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "cinder-74beaec8-0677-4edb-8e2b-54db2fa7bdac-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-74beaec8-0677-4edb-8e2b-54db2fa7bdac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "cinder-quobyte-74beaec8-0677-4edb-8e2b-54db2fa7bdac" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-quobyte-74beaec8-0677-4edb-8e2b-54db2fa7bdac" acquired by "delete_volume" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d0fbdc-73ae-48a6-910f-d2a12f13251f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:35 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac Nov 02 10:17:35 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:35 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac" returned: 0 in 0.361s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:35 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac Nov 02 10:17:35 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:36 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-74beaec8-0677-4edb-8e2b-54db2fa7bdac" returned: 0 in 0.241s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-quobyte-74beaec8-0677-4edb-8e2b-54db2fa7bdac" released by "delete_volume" :: held 0.643s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:36 devstack cinder-volume[87005]: WARNING cinder.quota [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-563567715-1992221793 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-563567715-1992221793, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:36 devstack cinder-volume[87005]: WARNING cinder.quota [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-563567715-1992221793 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-563567715-1992221793, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Created reservations ['0e4e8405-3f3e-4e4d-a499-d15e44f1a977', '94d64c66-7cfd-44d0-896d-daab6454bd13', 'a46fd463-d263-4229-9136-2f2f732d31d5', '690244f7-ecf4-4485-ba6e-db1e809f4244'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:36 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:36 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:36 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.236s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Deleted volume successfully. Nov 02 10:17:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-85827d9f-0ea1-4a73-91bf-585e368842cd tempest-TestInstancesWithCinderVolumes-891678405 None] Lock "cinder-74beaec8-0677-4edb-8e2b-54db2fa7bdac-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:48 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:48 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=49,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=44,cinder:UPDATE=38,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:48 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (0fe1dabd-401f-4a10-9a3f-8d990fc80cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb800ebc-b257-461b-8fac-7fba439a60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb800ebc-b257-461b-8fac-7fba439a60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-773953115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4482ee99-2a62-4721-854a-587e5d56ffc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:49Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435af183-ec64-4e3b-836a-448b4629207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435af183-ec64-4e3b-836a-448b4629207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a614db-f219-4524-8b4c-d5308143357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a614db-f219-4524-8b4c-d5308143357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4482ee99-2a62-4721-854a-587e5d56ffc7', 'volume_name': 'volume-4482ee99-2a62-4721-854a-587e5d56ffc7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c4e4de-87e6-4c79-9f80-e7d348497b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c4e4de-87e6-4c79-9f80-e7d348497b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bcfcc1-ea7a-423b-b16b-8e5b0040277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Volume 4482ee99-2a62-4721-854a-587e5d56ffc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4482ee99-2a62-4721-854a-587e5d56ffc7', 'volume_size': 1} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-773953115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4482ee99-2a62-4721-854a-587e5d56ffc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:49Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Creating volume 4482ee99-2a62-4721-854a-587e5d56ffc7 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:49 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:49 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.296s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:17:49 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 1073741824 Nov 02 10:17:49 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (56d7d1f8-0c88-4e34-8a49-12622dc1aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95eee016-d9ba-4458-b2bf-fdd0a3b86b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95eee016-d9ba-4458-b2bf-fdd0a3b86b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938013691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735208fb-f4c7-4274-bb96-92471d5643d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:49Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8e9d97-e64b-4d31-bc2f-1527b7c9f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8e9d97-e64b-4d31-bc2f-1527b7c9f802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05503eaf-89ca-40d9-b394-ccf797c219f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05503eaf-89ca-40d9-b394-ccf797c219f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735208fb-f4c7-4274-bb96-92471d5643d5', 'volume_name': 'volume-735208fb-f4c7-4274-bb96-92471d5643d5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3a5c75-e8c6-417b-b198-94cf548c1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3a5c75-e8c6-417b-b198-94cf548c1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394d5b36-fe96-4d77-a068-ffd1b54bc95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Volume 735208fb-f4c7-4274-bb96-92471d5643d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735208fb-f4c7-4274-bb96-92471d5643d5', 'volume_size': 1} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:49 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 1073741824" returned: 0 in 0.542s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:49 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 Nov 02 10:17:49 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (b1fd97d2-8b32-45ea-8269-e8dbf0876795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22945526-2b5a-44b4-a910-39470c359eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22945526-2b5a-44b4-a910-39470c359eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760038658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd4a0d2-df29-4d32-9a98-a747139c8772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:50Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a75157c-1fce-41ce-83e5-996c6289d020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a75157c-1fce-41ce-83e5-996c6289d020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34214e0-463e-4001-89a4-71ce8f3bc86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34214e0-463e-4001-89a4-71ce8f3bc86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd4a0d2-df29-4d32-9a98-a747139c8772', 'volume_name': 'volume-5dd4a0d2-df29-4d32-9a98-a747139c8772', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3cc413-579c-4d24-a3c5-f50bf5f03e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3cc413-579c-4d24-a3c5-f50bf5f03e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153c20d2-f5fb-4a07-8aa0-dfdb02ae2329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:49 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Volume 5dd4a0d2-df29-4d32-9a98-a747139c8772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd4a0d2-df29-4d32-9a98-a747139c8772', 'volume_size': 1} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:49 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7" returned: 0 in 0.280s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938013691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735208fb-f4c7-4274-bb96-92471d5643d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:49Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Creating volume 735208fb-f4c7-4274-bb96-92471d5643d5 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bcfcc1-ea7a-423b-b16b-8e5b0040277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4482ee99-2a62-4721-854a-587e5d56ffc7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389962dc-7a1c-43cc-a965-ebddb7ea4e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 1073741824 Nov 02 10:17:50 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Volume volume-4482ee99-2a62-4721-854a-587e5d56ffc7 (4482ee99-2a62-4721-854a-587e5d56ffc7): created successfully Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389962dc-7a1c-43cc-a965-ebddb7ea4e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (0fe1dabd-401f-4a10-9a3f-8d990fc80cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-df8bdff1-a317-4919-a57a-4e7c99196dd5 tempest-CreateVolumesFromImageTest-1308830970 None] Created volume successfully. Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (c6d7f3b1-12b6-4d67-8781-014ce7928200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb21a60c-f41b-452e-b235-1f350bd9f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb21a60c-f41b-452e-b235-1f350bd9f08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-516310906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049cbadf-4888-46b5-9ee6-467b4e2c8621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:50Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abecbed-03be-4cbf-8a48-3f60b7971770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abecbed-03be-4cbf-8a48-3f60b7971770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6459815-dbca-4586-b603-fc32429a8f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6459815-dbca-4586-b603-fc32429a8f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049cbadf-4888-46b5-9ee6-467b4e2c8621', 'volume_name': 'volume-049cbadf-4888-46b5-9ee6-467b4e2c8621', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf57080-e3df-4889-9670-dbaf7f934e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf57080-e3df-4889-9670-dbaf7f934e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cafc275-2825-406d-b6d4-e0e0f4bb9abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Volume 049cbadf-4888-46b5-9ee6-467b4e2c8621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049cbadf-4888-46b5-9ee6-467b4e2c8621', 'volume_size': 1} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:50 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 1073741824" returned: 0 in 0.491s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:50 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 Nov 02 10:17:50 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (eb0a78eb-be25-4422-a54a-a80a682cb8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b81145-508d-4aa3-adb0-dbf573275dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b81145-508d-4aa3-adb0-dbf573275dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878179044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:51Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422f967f-91fb-4e61-abcd-612c93e6491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422f967f-91fb-4e61-abcd-612c93e6491e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb694668-30f5-46d8-bb50-a26482302e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb694668-30f5-46d8-bb50-a26482302e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6', 'volume_name': 'volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b775a45a-c7d5-47af-8506-689de8c7414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b775a45a-c7d5-47af-8506-689de8c7414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa52ced-9f74-4736-90a1-9d4fe39732fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Volume 9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6', 'volume_size': 1} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:50 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5" returned: 0 in 0.252s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760038658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd4a0d2-df29-4d32-9a98-a747139c8772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:50Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Creating volume 5dd4a0d2-df29-4d32-9a98-a747139c8772 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394d5b36-fe96-4d77-a068-ffd1b54bc95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735208fb-f4c7-4274-bb96-92471d5643d5', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca131fc6-d18c-4912-90b1-99a80ff4db6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 1073741824 Nov 02 10:17:50 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Volume volume-735208fb-f4c7-4274-bb96-92471d5643d5 (735208fb-f4c7-4274-bb96-92471d5643d5): created successfully Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca131fc6-d18c-4912-90b1-99a80ff4db6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (56d7d1f8-0c88-4e34-8a49-12622dc1aca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8c144649-b3f9-404b-9ccd-b382ccb23b53 tempest-CreateVolumesFromImageTest-1308830970 None] Created volume successfully. Nov 02 10:17:51 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 1073741824" returned: 0 in 0.416s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:51 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 Nov 02 10:17:51 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:51 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772" returned: 0 in 0.230s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-516310906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049cbadf-4888-46b5-9ee6-467b4e2c8621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:50Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Creating volume 049cbadf-4888-46b5-9ee6-467b4e2c8621 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:51 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:51 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 1073741824 Nov 02 10:17:51 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153c20d2-f5fb-4a07-8aa0-dfdb02ae2329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd4a0d2-df29-4d32-9a98-a747139c8772', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e69a16-2439-4bd4-9b23-2189273947ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Volume volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 (5dd4a0d2-df29-4d32-9a98-a747139c8772): created successfully Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e69a16-2439-4bd4-9b23-2189273947ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (b1fd97d2-8b32-45ea-8269-e8dbf0876795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-31d88c0f-69e6-4256-8c82-4d67dfca30fb tempest-CreateVolumesFromImageTest-1308830970 None] Created volume successfully. Nov 02 10:17:51 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 1073741824" returned: 0 in 0.428s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:51 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 Nov 02 10:17:51 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:52 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621" returned: 0 in 0.245s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878179044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac30adf86a4d8bb169583ac56ec930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:51Z,use_quota=True,user_id='4d196d16b5bc4f3c876c553941b74954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Creating volume 9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:52 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cafc275-2825-406d-b6d4-e0e0f4bb9abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049cbadf-4888-46b5-9ee6-467b4e2c8621', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 1073741824 Nov 02 10:17:52 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0cdeec-76c3-4075-be28-3fc8159ae538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Volume volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 (049cbadf-4888-46b5-9ee6-467b4e2c8621): created successfully Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0cdeec-76c3-4075-be28-3fc8159ae538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (c6d7f3b1-12b6-4d67-8781-014ce7928200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-54a91d61-6863-4379-b8d5-2372f86aeba3 tempest-CreateVolumesFromImageTest-1308830970 None] Created volume successfully. Nov 02 10:17:52 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 1073741824" returned: 0 in 0.429s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:52 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 Nov 02 10:17:52 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:52 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6" returned: 0 in 0.249s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa52ced-9f74-4736-90a1-9d4fe39732fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e728aa2-e5f1-46a7-9711-7471abcc60ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Volume volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 (9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6): created successfully Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e728aa2-e5f1-46a7-9711-7471abcc60ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Flow 'volume_create_manager' (eb0a78eb-be25-4422-a54a-a80a682cb8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f48a71c1-0735-4ab9-ad2b-fc2a287e5147 tempest-CreateVolumesFromImageTest-1308830970 None] Created volume successfully. Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-quobyte-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e5db6-4aab-40f1-aaac-7501f8290dd0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:54 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 Nov 02 10:17:54 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:54 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6" returned: 0 in 0.365s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:54 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6 Nov 02 10:17:54 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:54 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6" returned: 0 in 0.244s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6" released by "delete_volume" :: held 0.653s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Created reservations ['fd040806-3234-4f98-b4e1-a883510b7101', '1db62514-f468-4c4c-b0e5-4675f3a06d24', '8cfcd1eb-ef07-4cb5-89f3-c517ecdbb0d1', '40220625-f8c7-41e5-9e71-879e21646121'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:54 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:54 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:55 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.238s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Deleted volume successfully. Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-45599f0b-3949-4ae3-9395-a1c4a681d413 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-9e99f4ee-1f3c-48b8-8bb4-fe5ec3db30c6-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-049cbadf-4888-46b5-9ee6-467b4e2c8621-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-049cbadf-4888-46b5-9ee6-467b4e2c8621-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-quobyte-049cbadf-4888-46b5-9ee6-467b4e2c8621" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-049cbadf-4888-46b5-9ee6-467b4e2c8621" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[70123253-4237-4dc2-bc9f-baefa367ff9b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:55 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 Nov 02 10:17:55 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:55 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621" returned: 0 in 0.391s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:55 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621 Nov 02 10:17:55 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:55 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-049cbadf-4888-46b5-9ee6-467b4e2c8621" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-049cbadf-4888-46b5-9ee6-467b4e2c8621" released by "delete_volume" :: held 0.699s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Created reservations ['b6b3dff6-3b3b-4192-8ce7-a86d37089e30', '93afe718-a191-403e-9801-bc8303990d00', 'b60dbe7b-5e5f-4590-a693-475715796eb6', '9357ce2e-0114-433f-a6c1-cb82fb8c391b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:56 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:56 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-5dd4a0d2-df29-4d32-9a98-a747139c8772-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:56 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-5dd4a0d2-df29-4d32-9a98-a747139c8772-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.298s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:56 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Deleted volume successfully. Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-13d55370-b444-417e-8e49-483961fc4667 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-049cbadf-4888-46b5-9ee6-467b4e2c8621-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-quobyte-5dd4a0d2-df29-4d32-9a98-a747139c8772" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-5dd4a0d2-df29-4d32-9a98-a747139c8772" acquired by "delete_volume" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c913a-0071-42b3-9e06-f1ea6a599cee]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:56 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 Nov 02 10:17:56 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:56 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772" returned: 0 in 0.448s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:56 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772 Nov 02 10:17:56 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-7d2aeb2e-610b-4c70-802c-83156fb0fc03 req-266dbc30-f8d4-4ec3-a3f4-0b79c6bb32b0 tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-7d2aeb2e-610b-4c70-802c-83156fb0fc03 req-266dbc30-f8d4-4ec3-a3f4-0b79c6bb32b0 tempest-TestStampPattern-408482898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [req-7d2aeb2e-610b-4c70-802c-83156fb0fc03 req-266dbc30-f8d4-4ec3-a3f4-0b79c6bb32b0 tempest-TestStampPattern-408482898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-7d2aeb2e-610b-4c70-802c-83156fb0fc03 req-266dbc30-f8d4-4ec3-a3f4-0b79c6bb32b0 tempest-TestStampPattern-408482898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9', 'name': 'volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f564e0c5-57d4-4704-8b95-ea09f07a0a4b', 'enforce_multipath': True} {{(pid=87005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:17:57 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5dd4a0d2-df29-4d32-9a98-a747139c8772" returned: 0 in 0.309s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-5dd4a0d2-df29-4d32-9a98-a747139c8772" released by "delete_volume" :: held 0.813s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-7d2aeb2e-610b-4c70-802c-83156fb0fc03 req-266dbc30-f8d4-4ec3-a3f4-0b79c6bb32b0 tempest-TestStampPattern-408482898 None] attachment_update completed successfully. Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Created reservations ['75f6db57-778e-4875-aa52-36bf93442285', 'ab298c7a-2245-4763-96d2-098153c3de6c', 'd547bd60-4591-4cb9-9b94-01f1b63137ce', '0d213da6-5117-42e5-8b85-ccc6744f9a6e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:57 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:57 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-735208fb-f4c7-4274-bb96-92471d5643d5-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-735208fb-f4c7-4274-bb96-92471d5643d5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-quobyte-735208fb-f4c7-4274-bb96-92471d5643d5" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-735208fb-f4c7-4274-bb96-92471d5643d5" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[21abf509-770a-41d1-97af-9323f7e960ee]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:57 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.302s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Deleted volume successfully. Nov 02 10:17:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-37425e0f-018d-4e76-b734-b4d1ee56bc94 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-5dd4a0d2-df29-4d32-9a98-a747139c8772-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:57 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 Nov 02 10:17:57 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:58 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5" returned: 0 in 0.466s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:58 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5 Nov 02 10:17:58 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:58 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-735208fb-f4c7-4274-bb96-92471d5643d5" returned: 0 in 0.271s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-735208fb-f4c7-4274-bb96-92471d5643d5" released by "delete_volume" :: held 0.788s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Created reservations ['731a0708-65b0-41bf-a234-3c3d36d6d583', '7e4b9eeb-e09b-48bb-b1d1-2f486ee08426', 'a6cef8bf-9949-43f1-b8bd-00624f55b25f', '5e9fed27-1b23-42f5-bfb3-ddf381047d32'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:58 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:58 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-4482ee99-2a62-4721-854a-587e5d56ffc7-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-4482ee99-2a62-4721-854a-587e5d56ffc7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "cinder-quobyte-4482ee99-2a62-4721-854a-587e5d56ffc7" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-4482ee99-2a62-4721-854a-587e5d56ffc7" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:58 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.315s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:58 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Deleted volume successfully. Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d026a86-7284-4a60-b96c-baef76353695]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8df002a0-539c-48c2-b947-fa3784c20426 tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-735208fb-f4c7-4274-bb96-92471d5643d5-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:59 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 Nov 02 10:17:59 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:59 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7" returned: 0 in 0.395s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:59 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7 Nov 02 10:17:59 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:59 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4482ee99-2a62-4721-854a-587e5d56ffc7" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-quobyte-4482ee99-2a62-4721-854a-587e5d56ffc7" released by "delete_volume" :: held 0.840s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Created reservations ['be56dc51-62f8-44cf-be55-0c5feba0fe6f', '4e20177e-09a2-4330-9f94-a0d31b932f86', '66ec6adc-c303-4029-af16-2dd073a27b1f', 'e3f8cd86-7879-4242-8209-5c70ab4f0e85'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:59 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:17:59 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:00 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.408s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:00 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Deleted volume successfully. Nov 02 10:18:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-66848e7c-2ade-4b5d-9ad7-ab2499c35a3e tempest-CreateVolumesFromImageTest-1308830970 None] Lock "cinder-4482ee99-2a62-4721-854a-587e5d56ffc7-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [req-2ac3bcc3-893b-4eaf-be8c-e54f8f05e96f req-12eb9dd1-dd4a-4186-ac81-a08414a331e8 tempest-TestStampPattern-408482898 None] Terminate volume connection completed successfully. Nov 02 10:18:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [req-2ac3bcc3-893b-4eaf-be8c-e54f8f05e96f req-12eb9dd1-dd4a-4186-ac81-a08414a331e8 tempest-TestStampPattern-408482898 None] Deleting attachment f564e0c5-57d4-4704-8b95-ea09f07a0a4b. {{(pid=87005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (2c640cbe-66df-479e-9c19-c4e51bf57ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b44675a-2154-43c2-a7d9-41d504842bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b44675a-2154-43c2-a7d9-41d504842bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351147985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab6353d-15f8-411c-ba58-3c261c4d0a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:04Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6802d9bd-7178-4b36-9cca-1498a9d256d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6802d9bd-7178-4b36-9cca-1498a9d256d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bef7aa9-b791-4d31-9a86-51861c14cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bef7aa9-b791-4d31-9a86-51861c14cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab6353d-15f8-411c-ba58-3c261c4d0a0e', 'volume_name': 'volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bfa71b-8b31-4e74-95f0-8f9042f6e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bfa71b-8b31-4e74-95f0-8f9042f6e07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6678dc-a7b1-486d-ade5-78d3e5c8a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:03 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume 3ab6353d-15f8-411c-ba58-3c261c4d0a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e', 'volume_size': 1} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351147985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab6353d-15f8-411c-ba58-3c261c4d0a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:04Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Creating volume 3ab6353d-15f8-411c-ba58-3c261c4d0a0e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:03 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:03 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e 1073741824 Nov 02 10:18:03 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:04 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e 1073741824" returned: 0 in 0.573s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:04 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e Nov 02 10:18:04 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:04 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e" returned: 0 in 0.253s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6678dc-a7b1-486d-ade5-78d3e5c8a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7390d1b-3270-4eb0-a62e-fe4089445081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:04 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e (3ab6353d-15f8-411c-ba58-3c261c4d0a0e): created successfully Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7390d1b-3270-4eb0-a62e-fe4089445081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (2c640cbe-66df-479e-9c19-c4e51bf57ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:04 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-22ab5b3d-a579-4ccd-a8e9-11e31e68222b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created volume successfully. Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-17e2d47b-e5ae-4ac1-8b66-6523be53f87d-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Lock "cinder-17e2d47b-e5ae-4ac1-8b66-6523be53f87d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-quobyte-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[96838284-6fda-40d2-a9d2-892774396efd]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:05 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d Nov 02 10:18:05 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:05 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" returned: 0 in 0.363s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:05 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d Nov 02 10:18:05 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:06 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" returned: 0 in 0.255s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-17e2d47b-e5ae-4ac1-8b66-6523be53f87d" released by "delete_volume" :: held 0.667s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Created reservations ['a5134187-e92d-44c5-b366-faef8acb36f0', 'aee2cb3b-431f-4872-aa49-08e90e302fbf', 'f390ab3d-d924-452f-99a2-2ff4c5ce0b92', 'a7967be2-3990-4b29-959a-d511202646ee'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (d0f2df4b-cfdc-43f9-9451-90b78bc905dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717ebdf2-8221-4a39-a815-8f20edc0a8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717ebdf2-8221-4a39-a815-8f20edc0a8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056290128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e94b934-01d6-40c6-987e-d5ab73e2d58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:06Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c82673-f9fe-43ed-a15f-35613fde7fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c82673-f9fe-43ed-a15f-35613fde7fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730bda7a-e5e9-473c-94b1-c3e67e608046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730bda7a-e5e9-473c-94b1-c3e67e608046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e94b934-01d6-40c6-987e-d5ab73e2d58e', 'volume_name': 'volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bf05a0-ee21-4103-9f94-bc4a545bab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bf05a0-ee21-4103-9f94-bc4a545bab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c21cab-e9a7-403e-96c1-8dfdd8fceda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume 9e94b934-01d6-40c6-987e-d5ab73e2d58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e', 'volume_size': 1} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056290128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e94b934-01d6-40c6-987e-d5ab73e2d58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:06Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Creating volume 9e94b934-01d6-40c6-987e-d5ab73e2d58e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:06 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:06 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e 1073741824 Nov 02 10:18:06 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:06 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:06 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (d55a8b3b-bc7b-48d8-8a1d-1038b811a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a131b1a-3cb2-4bd6-88b0-68504c616978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a131b1a-3cb2-4bd6-88b0-68504c616978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918387971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:07Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d911eb0-2a77-4b2a-8189-0731e539bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d911eb0-2a77-4b2a-8189-0731e539bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63541650-bfcb-4a39-a9c3-3ef0275cf1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63541650-bfcb-4a39-a9c3-3ef0275cf1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e', 'volume_name': 'volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e709a0a4-8591-460a-ab75-57780585f978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e709a0a4-8591-460a-ab75-57780585f978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:06 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5babbb5-a349-401b-9a49-6c22a6348165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:06 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume 5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e', 'volume_size': 1} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.427s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Deleted volume successfully. Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5cef0472-b926-47cc-be67-612c4037c367 tempest-TestStampPattern-408482898 None] Lock "cinder-17e2d47b-e5ae-4ac1-8b66-6523be53f87d-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:06 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e 1073741824" returned: 0 in 0.630s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-3ce86736-850a-4153-9f7d-bbb3310a1c52-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Lock "cinder-3ce86736-850a-4153-9f7d-bbb3310a1c52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-quobyte-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-quobyte-3ce86736-850a-4153-9f7d-bbb3310a1c52" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:07 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e Nov 02 10:18:07 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-3ce86736-850a-4153-9f7d-bbb3310a1c52" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Deleting offline snapshot 3ce86736-850a-4153-9f7d-bbb3310a1c52 of volume 5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] snapshot_file for this snap is: volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6230acf2-cbec-40d3-9ef4-b72391b6ceed]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:07 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 Nov 02 10:18:07 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (c93516c1-215b-4479-b497-4670e67a83ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b382dcbe-718c-4619-aec1-5bd3b7367cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b382dcbe-718c-4619-aec1-5bd3b7367cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312227841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00978f53-8710-4117-a359-02ff78efd021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:07Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0290c03-a25c-487e-9b7e-ee2849c71f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0290c03-a25c-487e-9b7e-ee2849c71f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33209624-2ff9-4849-a143-f17200a85153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33209624-2ff9-4849-a143-f17200a85153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00978f53-8710-4117-a359-02ff78efd021', 'volume_name': 'volume-00978f53-8710-4117-a359-02ff78efd021', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912d934e-b42e-494d-9ead-6c742f3ed7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912d934e-b42e-494d-9ead-6c742f3ed7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0a4483-7643-48f6-825b-50d97ee65928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume 00978f53-8710-4117-a359-02ff78efd021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00978f53-8710-4117-a359-02ff78efd021', 'volume_size': 1} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:07 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e" returned: 0 in 0.416s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918387971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:07Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Creating volume 5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:07 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:07 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e 1073741824 Nov 02 10:18:07 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c21cab-e9a7-403e-96c1-8dfdd8fceda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71339a01-e841-4b6b-8bb5-523e47a11221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e (9e94b934-01d6-40c6-987e-d5ab73e2d58e): created successfully Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71339a01-e841-4b6b-8bb5-523e47a11221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (d0f2df4b-cfdc-43f9-9451-90b78bc905dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:07 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-46fbcc75-084d-47b8-b1c7-a442da8f5657 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created volume successfully. Nov 02 10:18:07 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52" returned: 0 in 0.486s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf38251-eafb-42e9-9984-ec5fb205984a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:07 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 Nov 02 10:18:07 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (cc2e9a62-0f01-48ef-aad0-ac3c0c5f6495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c269790c-6abd-4b30-a497-b314bcb71603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c269790c-6abd-4b30-a497-b314bcb71603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871765633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943d905e-8bb8-408e-99b5-12628b99288d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:08Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f732397c-97e2-4d48-b20b-0096e4414a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f732397c-97e2-4d48-b20b-0096e4414a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b62b896-fc0b-424b-8a05-c9114f22bfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b62b896-fc0b-424b-8a05-c9114f22bfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943d905e-8bb8-408e-99b5-12628b99288d', 'volume_name': 'volume-943d905e-8bb8-408e-99b5-12628b99288d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c724c-e7f2-4ab9-98ad-9836838a6be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c724c-e7f2-4ab9-98ad-9836838a6be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fede6b3-b5dc-4c8b-9704-6fd1fe395076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:07 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume 943d905e-8bb8-408e-99b5-12628b99288d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943d905e-8bb8-408e-99b5-12628b99288d', 'volume_size': 1} Nov 02 10:18:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:08 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e 1073741824" returned: 0 in 0.597s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e Nov 02 10:18:08 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (617f24bd-f001-43fb-adcd-152c3cea3ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ffce6e-a861-4e7d-b89d-14109b6ebc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ffce6e-a861-4e7d-b89d-14109b6ebc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-318620893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd86a871-16c2-4300-bbd5-0e5469cbe789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:08Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804f1e52-6b3b-4bb8-af26-f13ed4825b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804f1e52-6b3b-4bb8-af26-f13ed4825b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55eb6ee-c265-4a4f-a91c-96dccb6a6910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55eb6ee-c265-4a4f-a91c-96dccb6a6910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd86a871-16c2-4300-bbd5-0e5469cbe789', 'volume_name': 'volume-dd86a871-16c2-4300-bbd5-0e5469cbe789', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e08664-8992-45b0-bd4b-85bd64a1e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e08664-8992-45b0-bd4b-85bd64a1e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f245aa-50ba-4807-bf1a-a35e72d34f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:08 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume dd86a871-16c2-4300-bbd5-0e5469cbe789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd86a871-16c2-4300-bbd5-0e5469cbe789', 'volume_size': 1} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:08 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" returned: 0 in 0.684s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 Nov 02 10:18:08 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e" returned: 0 in 0.277s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312227841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00978f53-8710-4117-a359-02ff78efd021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:07Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Creating volume 00978f53-8710-4117-a359-02ff78efd021 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:08 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5babbb5-a349-401b-9a49-6c22a6348165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:08 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 1073741824 Nov 02 10:18:08 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47770ea0-a81b-4425-984b-86b0549b113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:08 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e (5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e): created successfully Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47770ea0-a81b-4425-984b-86b0549b113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (d55a8b3b-bc7b-48d8-8a1d-1038b811a300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c2ca20d6-f4d0-4930-bbe3-26706d77ae51 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created volume successfully. Nov 02 10:18:08 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52" returned: 0 in 0.325s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52 Nov 02 10:18:08 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 1073741824" returned: 0 in 0.419s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 Nov 02 10:18:08 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36.3ce86736-850a-4153-9f7d-bbb3310a1c52" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-3ce86736-850a-4153-9f7d-bbb3310a1c52" released by "_delete_snapshot" :: held 1.906s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" released by "delete_snapshot" :: held 1.931s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Created reservations ['f0877c47-482e-4218-affd-6dd1dcefc7ec', 'e276290c-3fea-48e8-b733-377a7068d4ab', '1eadb563-2d54-4a13-aac8-f49bfb1733a8', 'f026b446-2ab9-465c-9989-1c01ecba4b9c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Delete snapshot completed successfully. Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6346afe-8640-4422-b112-97a8abb84dea tempest-TestStampPattern-408482898 None] Lock "cinder-3ce86736-850a-4153-9f7d-bbb3310a1c52-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:09 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021" returned: 0 in 0.290s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871765633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943d905e-8bb8-408e-99b5-12628b99288d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:08Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Creating volume 943d905e-8bb8-408e-99b5-12628b99288d {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:09 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0a4483-7643-48f6-825b-50d97ee65928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00978f53-8710-4117-a359-02ff78efd021', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2e1d0b-077d-4d1a-bc31-edc095081933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:09 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d 1073741824 Nov 02 10:18:09 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume volume-00978f53-8710-4117-a359-02ff78efd021 (00978f53-8710-4117-a359-02ff78efd021): created successfully Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2e1d0b-077d-4d1a-bc31-edc095081933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (c93516c1-215b-4479-b497-4670e67a83ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ec5f37e0-72dd-4ee6-bfbe-5135c6bfaa2b tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created volume successfully. Nov 02 10:18:09 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d 1073741824" returned: 0 in 0.458s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:09 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d Nov 02 10:18:09 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:09 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d" returned: 0 in 0.280s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-318620893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd86a871-16c2-4300-bbd5-0e5469cbe789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f045bb5994143948be2b3bd2721812b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:08Z,use_quota=True,user_id='7a17d71e44574d248ca064ac61462f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Creating volume dd86a871-16c2-4300-bbd5-0e5469cbe789 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:09 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:09 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 1073741824 Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fede6b3-b5dc-4c8b-9704-6fd1fe395076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943d905e-8bb8-408e-99b5-12628b99288d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:09 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e31a78-04cc-483b-aa55-195966eb7126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume volume-943d905e-8bb8-408e-99b5-12628b99288d (943d905e-8bb8-408e-99b5-12628b99288d): created successfully Nov 02 10:18:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e31a78-04cc-483b-aa55-195966eb7126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (cc2e9a62-0f01-48ef-aad0-ac3c0c5f6495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:10 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e437bfec-c043-4e43-81ee-b81b01b7ce08 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created volume successfully. Nov 02 10:18:10 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 1073741824" returned: 0 in 0.840s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:10 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 Nov 02 10:18:10 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:11 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789" returned: 0 in 0.290s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f245aa-50ba-4807-bf1a-a35e72d34f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd86a871-16c2-4300-bbd5-0e5469cbe789', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9f05c6-55b9-4eeb-bbaf-dd1dec62dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:11 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Volume volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 (dd86a871-16c2-4300-bbd5-0e5469cbe789): created successfully Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9f05c6-55b9-4eeb-bbaf-dd1dec62dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Flow 'volume_create_manager' (617f24bd-f001-43fb-adcd-152c3cea3ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-19fc792e-c0f9-4529-abf4-04ed2611760f tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created volume successfully. Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-dd86a871-16c2-4300-bbd5-0e5469cbe789-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-dd86a871-16c2-4300-bbd5-0e5469cbe789-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-quobyte-dd86a871-16c2-4300-bbd5-0e5469cbe789" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-dd86a871-16c2-4300-bbd5-0e5469cbe789" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb8ef1-b570-4a82-b941-8b026673443a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:11 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 Nov 02 10:18:11 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:12 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789" returned: 0 in 0.451s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:12 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789 Nov 02 10:18:12 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:12 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd86a871-16c2-4300-bbd5-0e5469cbe789" returned: 0 in 0.243s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-dd86a871-16c2-4300-bbd5-0e5469cbe789" released by "delete_volume" :: held 0.742s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created reservations ['57d8c0ee-1a3d-4d17-9eba-7536a0d51e48', '97d8e3b5-bc47-4090-9f7e-d6c1d5b127bc', 'e0d9bcc9-75da-41bf-a66b-9554e457fa5c', 'c3093b19-6c4b-4ef4-b978-677aef419338'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:12 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:12 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-943d905e-8bb8-408e-99b5-12628b99288d-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-943d905e-8bb8-408e-99b5-12628b99288d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:12 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.294s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-quobyte-943d905e-8bb8-408e-99b5-12628b99288d" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Deleted volume successfully. Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-943d905e-8bb8-408e-99b5-12628b99288d" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f358d426-9882-4a09-961b-04d83e8b7819 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-dd86a871-16c2-4300-bbd5-0e5469cbe789-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf8d11d-eac6-4d94-9f94-560c61b45e59]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-5693f66f-ace0-45a8-82a2-86c8a3a0ca36-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Lock "cinder-5693f66f-ace0-45a8-82a2-86c8a3a0ca36-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:13 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d Nov 02 10:18:13 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Acquiring lock "cinder-quobyte-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b24aec-ed3b-4212-bf1d-9e9be508e192]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:13 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 Nov 02 10:18:13 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:13 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d" returned: 0 in 0.440s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:13 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d Nov 02 10:18:13 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:13 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" returned: 0 in 0.404s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:13 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36 Nov 02 10:18:13 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:13 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-943d905e-8bb8-408e-99b5-12628b99288d" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-943d905e-8bb8-408e-99b5-12628b99288d" released by "delete_volume" :: held 0.750s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created reservations ['ffbfec63-08e5-461b-8d09-8d470a338ef5', '5047a1c9-dad2-4a6a-a63b-9e103514ea62', '6adb9c37-61cd-4b11-ae3b-d3e04e4ed019', 'b0f501ca-aa92-4653-b002-629aca992360'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:13 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:13 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:13 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" returned: 0 in 0.283s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Lock "cinder-quobyte-5693f66f-ace0-45a8-82a2-86c8a3a0ca36" released by "delete_volume" :: held 0.746s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:13 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Created reservations ['1a27ef1a-a93c-4a28-8392-071c5bf571ba', '7a87aa33-74f2-4225-9e59-9370f77d66fd', '528ae558-f143-4e3d-ae22-0f989de06ff1', 'c0e657ad-44dc-40a9-95f2-273f478d69d0'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:14 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:14 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-00978f53-8710-4117-a359-02ff78efd021-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-00978f53-8710-4117-a359-02ff78efd021-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-quobyte-00978f53-8710-4117-a359-02ff78efd021" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:14 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.304s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-00978f53-8710-4117-a359-02ff78efd021" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Deleted volume successfully. Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8891e5-6243-47ac-955d-5a4534a86fc0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2007fc84-df39-4dbb-853b-1260de4020e2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-943d905e-8bb8-408e-99b5-12628b99288d-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:14 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 Nov 02 10:18:14 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:14 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.330s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Deleted volume successfully. Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c2605583-f5ae-4258-8f48-8a913b149c97 tempest-TestStampPattern-408482898 None] Lock "cinder-5693f66f-ace0-45a8-82a2-86c8a3a0ca36-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:14 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021" returned: 0 in 0.398s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:14 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021 Nov 02 10:18:14 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:14 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-00978f53-8710-4117-a359-02ff78efd021" returned: 0 in 0.269s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-00978f53-8710-4117-a359-02ff78efd021" released by "delete_volume" :: held 0.729s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created reservations ['e29ffd10-f884-4212-8324-cf2f07975f51', 'e0e33d80-4497-4f01-9d20-8460a5053f32', '2dd23f9e-8f7c-4603-88ec-7308a966e89f', 'fe3a6c0d-447b-42d2-9e50-b749c9b7bf75'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:14 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:15 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:15 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:15 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.263s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Deleted volume successfully. Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-514869e1-1681-4b81-b518-eb515f8723b0 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-00978f53-8710-4117-a359-02ff78efd021-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-quobyte-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e" acquired by "delete_volume" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f35c3-cb50-4baf-a03a-1b5ec0d09a42]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:15 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e Nov 02 10:18:15 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:15 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e" returned: 0 in 0.394s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:15 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e Nov 02 10:18:15 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:16 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e" returned: 0 in 0.253s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e" released by "delete_volume" :: held 0.693s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created reservations ['432c7a8f-03d4-4c63-b618-d5ecbf75246e', 'd8dc5886-6f0b-4bcc-8f57-62f36f112e82', '81161a24-3d38-4a7c-b2f4-ba997ce5ec2d', '706fc2f3-de17-40d7-b54b-28c7d2a65cb2'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:16 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:16 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-9e94b934-01d6-40c6-987e-d5ab73e2d58e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-9e94b934-01d6-40c6-987e-d5ab73e2d58e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:16 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.292s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Deleted volume successfully. Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-quobyte-9e94b934-01d6-40c6-987e-d5ab73e2d58e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12c3cb33-25c9-4355-a932-13e93041daa8 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-5ebe7ebb-f00a-4648-83f2-a7ac0cf4987e-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-9e94b934-01d6-40c6-987e-d5ab73e2d58e" acquired by "delete_volume" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[59450f24-e9a3-49fa-a349-8fc502f255c7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:16 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e Nov 02 10:18:16 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:16 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e" returned: 0 in 0.376s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:16 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e Nov 02 10:18:16 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:17 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-9e94b934-01d6-40c6-987e-d5ab73e2d58e" returned: 0 in 0.257s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-9e94b934-01d6-40c6-987e-d5ab73e2d58e" released by "delete_volume" :: held 0.676s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created reservations ['a7043437-3a0f-4375-95b0-c59e0c8fc9f3', '4bec8832-21dd-4f1b-9bbb-5e8f9c0c0fb3', '10816cd6-898f-47eb-9531-ca6665d499ab', 'b296195d-2e8b-4f18-aab0-b03a7240bcdb'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:17 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:17 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:17 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.250s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-3ab6353d-15f8-411c-ba58-3c261c4d0a0e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:17 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Deleted volume successfully. Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-924c65fc-c36e-4cfe-a5cc-ad6fbdccdfd2 tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-9e94b934-01d6-40c6-987e-d5ab73e2d58e-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-3ab6353d-15f8-411c-ba58-3c261c4d0a0e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "cinder-quobyte-3ab6353d-15f8-411c-ba58-3c261c4d0a0e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-3ab6353d-15f8-411c-ba58-3c261c4d0a0e" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d58fe-064f-49d1-8b2e-f7944c0eb051]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:17 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e Nov 02 10:18:17 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:18 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e" returned: 0 in 0.393s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:18 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e Nov 02 10:18:18 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:18 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ab6353d-15f8-411c-ba58-3c261c4d0a0e" returned: 0 in 0.300s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-quobyte-3ab6353d-15f8-411c-ba58-3c261c4d0a0e" released by "delete_volume" :: held 0.738s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Created reservations ['029d66ca-f58f-4343-ab38-000b4a1742ea', 'eee7a305-55ef-43cf-a178-34a0b9036d90', '3faca663-4dee-4f83-af6d-3e9649ca006b', '60b17432-97fd-4365-889e-7d53a44aeff3'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:18 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:18 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:18 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.283s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Deleted volume successfully. Nov 02 10:18:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5af0d59c-1676-49ff-8c2a-4b86aaab176c tempest-CreateVolumesFromSourceVolumeTest-1255760844 None] Lock "cinder-3ab6353d-15f8-411c-ba58-3c261c4d0a0e-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Flow 'volume_create_manager' (8a2e8d7a-d8f5-494a-8a6d-afc345d54a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62ca32a-ab7e-489b-b53e-20cd9d08741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62ca32a-ab7e-489b-b53e-20cd9d08741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265914585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b000afeb-9b17-4931-b7b3-b44cdad1beb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a5ad257d024aa4970e3d08b0b4eb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:22Z,use_quota=True,user_id='117e08def60d435c97bb40cffa0c5162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62166cc4-5d56-4bbe-8324-8a35e0a99486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62166cc4-5d56-4bbe-8324-8a35e0a99486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177b82c8-f369-457e-8e19-c7a36ea6f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177b82c8-f369-457e-8e19-c7a36ea6f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b000afeb-9b17-4931-b7b3-b44cdad1beb1', 'volume_name': 'volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f98bf82-c038-481c-8276-0d0d7ff76e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f98bf82-c038-481c-8276-0d0d7ff76e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89c6064-063c-4a0a-807d-bf371fbf51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Volume b000afeb-9b17-4931-b7b3-b44cdad1beb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1', 'volume_size': 1} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265914585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b000afeb-9b17-4931-b7b3-b44cdad1beb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a5ad257d024aa4970e3d08b0b4eb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:22Z,use_quota=True,user_id='117e08def60d435c97bb40cffa0c5162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Creating volume b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:22 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:22 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 1073741824 Nov 02 10:18:22 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:22 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 1073741824" returned: 0 in 0.425s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:22 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 Nov 02 10:18:22 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:22 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89c6064-063c-4a0a-807d-bf371fbf51aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40cd23b-a8ab-47e5-ac16-527109d828d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Volume volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 (b000afeb-9b17-4931-b7b3-b44cdad1beb1): created successfully Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40cd23b-a8ab-47e5-ac16-527109d828d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Flow 'volume_create_manager' (8a2e8d7a-d8f5-494a-8a6d-afc345d54a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-647b12e8-7909-4b0e-a74c-b58df1b30ee2 tempest-VolumeDependencyTests-2095455600 None] Created volume successfully. Nov 02 10:18:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Creating offline snapshot 11837f08-042e-42a1-8b42-961ae71491de of volume b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:18:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[06475885-8ec4-486a-b57d-c84d5d17f138]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:23 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 Nov 02 10:18:23 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:23 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1" returned: 0 in 0.431s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:23 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de 1G Nov 02 10:18:23 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:24 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de 1G" returned: 0 in 0.445s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:24 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de Nov 02 10:18:24 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:24 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de" returned: 0 in 0.361s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:24 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de is being set with open permissions: ugo+rw Nov 02 10:18:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:24 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de Nov 02 10:18:24 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:24 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:24 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.info Nov 02 10:18:24 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:25 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.info" returned: 0 in 0.301s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:25 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.info is being set with open permissions: ugo+rw Nov 02 10:18:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:25 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.info Nov 02 10:18:25 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:25 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.info" returned: 0 in 0.285s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5b5ba961-1249-487e-bd12-032851f0f864 tempest-VolumeDependencyTests-2095455600 None] Create snapshot completed successfully Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Flow 'volume_create_manager' (94ab5c35-c8e9-45b7-993a-60b420d34758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7840399b-fda3-43df-ba29-4850310c8e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7840399b-fda3-43df-ba29-4850310c8e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-958699196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a5ad257d024aa4970e3d08b0b4eb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11837f08-042e-42a1-8b42-961ae71491de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:27Z,use_quota=True,user_id='117e08def60d435c97bb40cffa0c5162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca314d79-099b-4230-9315-2f2b06af171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca314d79-099b-4230-9315-2f2b06af171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ee4811-b9e3-4eb5-b56d-472e51712dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ee4811-b9e3-4eb5-b56d-472e51712dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e', 'volume_name': 'volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e', 'volume_size': 1, 'snapshot_id': '11837f08-042e-42a1-8b42-961ae71491de'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322429b5-1224-49c8-970e-35567cdc93f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322429b5-1224-49c8-970e-35567cdc93f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a5feb4-d3b6-43c8-92ca-f314f00efa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Volume faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e', 'volume_size': 1, 'snapshot_id': '11837f08-042e-42a1-8b42-961ae71491de'} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-quobyte-11837f08-042e-42a1-8b42-961ae71491de-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-11837f08-042e-42a1-8b42-961ae71491de-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Creating volume faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e from snapshot 11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-quobyte-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] snapshot: 11837f08-042e-42a1-8b42-961ae71491de, volume: faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[63741bb5-c366-4d66-b830-ba24827f78a6]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:27 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de Nov 02 10:18:27 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Flow 'volume_create_manager' (27563378-5628-46e8-af7a-e88fd40a8a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853af5eb-21b2-4264-9da4-005a1b6a67f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853af5eb-21b2-4264-9da4-005a1b6a67f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f51f2bb-b9c3-4529-a838-38b16ca6e205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d19998809040ad9393fc64148a9a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:28Z,use_quota=True,user_id='b89d87c9c9e74899b838054459e7aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532a61b8-76b3-434c-8e54-fadef8d8af8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532a61b8-76b3-434c-8e54-fadef8d8af8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ee8db9-0003-4cc2-87cb-c55f03ee4c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ee8db9-0003-4cc2-87cb-c55f03ee4c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f51f2bb-b9c3-4529-a838-38b16ca6e205', 'volume_name': 'volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c9ecbc-18ab-4e0f-86aa-e43175f5b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c9ecbc-18ab-4e0f-86aa-e43175f5b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e6a117-927a-42dd-9a3c-d0d2756585a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:27 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Volume 3f51f2bb-b9c3-4529-a838-38b16ca6e205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205', 'volume_size': 1} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de" returned: 0 in 0.406s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ef6fe-90e2-42fc-a71c-301d68df07d5]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:27 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 Nov 02 10:18:27 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:28 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1" returned: 0 in 0.341s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:18:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:18:28 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:18:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:28 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e Nov 02 10:18:28 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:33 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" returned: 0 in 5.723s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:33 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:18:33 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Converted 1024.00 MB image at 178.89 MB/s Nov 02 10:18:33 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e is being set with open permissions: ugo+rw Nov 02 10:18:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:33 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e Nov 02 10:18:33 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:33 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" returned: 0 in 0.223s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" released by "_copy_volume_from_snapshot" :: held 6.775s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-11837f08-042e-42a1-8b42-961ae71491de-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" released by "_create_volume_from_snapshot" :: held 6.837s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.852s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.358s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f51f2bb-b9c3-4529-a838-38b16ca6e205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d19998809040ad9393fc64148a9a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:28Z,use_quota=True,user_id='b89d87c9c9e74899b838054459e7aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Creating volume 3f51f2bb-b9c3-4529-a838-38b16ca6e205 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:34 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:34 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 1073741824 Nov 02 10:18:34 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a5feb4-d3b6-43c8-92ca-f314f00efa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e', 'volume_size': 1, 'snapshot_id': '11837f08-042e-42a1-8b42-961ae71491de'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c88462f-227d-4c88-b498-4b9879c8cbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:34 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Volume volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e (faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e): created successfully Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c88462f-227d-4c88-b498-4b9879c8cbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Flow 'volume_create_manager' (94ab5c35-c8e9-45b7-993a-60b420d34758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b1246866-6dbf-4f0e-9cf3-64068fe0a1b1 tempest-VolumeDependencyTests-2095455600 None] Created volume successfully. Nov 02 10:18:34 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 1073741824" returned: 0 in 0.397s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:34 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 Nov 02 10:18:34 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-11837f08-042e-42a1-8b42-961ae71491de-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-11837f08-042e-42a1-8b42-961ae71491de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-quobyte-b000afeb-9b17-4931-b7b3-b44cdad1beb1" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-b000afeb-9b17-4931-b7b3-b44cdad1beb1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-quobyte-11837f08-042e-42a1-8b42-961ae71491de" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-11837f08-042e-42a1-8b42-961ae71491de" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Deleting offline snapshot 11837f08-042e-42a1-8b42-961ae71491de of volume b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] snapshot_file for this snap is: volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fe637c-b66a-4c2d-b196-285b9fe30645]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:34 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e6a117-927a-42dd-9a3c-d0d2756585a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e058c2e0-8664-48a3-9889-a86285a00747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:34 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de Nov 02 10:18:34 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:34 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Volume volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 (3f51f2bb-b9c3-4529-a838-38b16ca6e205): created successfully Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e058c2e0-8664-48a3-9889-a86285a00747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Flow 'volume_create_manager' (27563378-5628-46e8-af7a-e88fd40a8a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-94a6aace-64a1-467d-bf40-88154bb5f4c0 tempest-CinderUnicodeTest-2135706564 None] Created volume successfully. Nov 02 10:18:35 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de" returned: 0 in 0.358s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f7ad2-711f-4a59-a1a0-78f0dc46b12e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:35 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 Nov 02 10:18:35 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:35 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1" returned: 0 in 0.534s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:35 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de Nov 02 10:18:35 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Flow 'volume_create_manager' (5975a34a-e558-4854-b78c-d0028ee42747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396b5b60-a3ff-4182-864e-7fd9b445a3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396b5b60-a3ff-4182-864e-7fd9b445a3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276084194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1972c2-1da6-4f8e-9d20-0b106e57c97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d19998809040ad9393fc64148a9a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:36Z,use_quota=True,user_id='b89d87c9c9e74899b838054459e7aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d604e7d1-77a5-476d-921f-f4a4032f68e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d604e7d1-77a5-476d-921f-f4a4032f68e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aef9ac-539d-44e9-a3d2-769d11ef6569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aef9ac-539d-44e9-a3d2-769d11ef6569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1972c2-1da6-4f8e-9d20-0b106e57c97e', 'volume_name': 'volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db9823b-52f2-45f2-b634-7a023a4a0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db9823b-52f2-45f2-b634-7a023a4a0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b3db20-3088-4a12-9189-206a30f95751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:35 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Volume dd1972c2-1da6-4f8e-9d20-0b106e57c97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e', 'volume_size': 1} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276084194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1972c2-1da6-4f8e-9d20-0b106e57c97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d19998809040ad9393fc64148a9a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:36Z,use_quota=True,user_id='b89d87c9c9e74899b838054459e7aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Creating volume dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:35 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:35 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de" returned: 0 in 0.361s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:35 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e 1073741824 Nov 02 10:18:35 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:35 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de Nov 02 10:18:35 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:36 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1.11837f08-042e-42a1-8b42-961ae71491de" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-11837f08-042e-42a1-8b42-961ae71491de" released by "_delete_snapshot" :: held 1.611s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-b000afeb-9b17-4931-b7b3-b44cdad1beb1" released by "delete_snapshot" :: held 1.638s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Created reservations ['0e16fe3f-f3a6-4fe0-8f1d-2072ca5151e6', '60b21773-e5e1-471a-a3b2-1f6befe6f26f', 'db73e7c9-3123-431c-ab43-caffa6d47fac', '371276da-6ffe-4534-b9ce-07930bf4cf23'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Delete snapshot completed successfully. Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e9d0022d-4bf9-4a5f-9438-1dc12f382277 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-11837f08-042e-42a1-8b42-961ae71491de-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:36 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e 1073741824" returned: 0 in 0.454s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:36 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e Nov 02 10:18:36 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:36 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" returned: 0 in 0.226s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b3db20-3088-4a12-9189-206a30f95751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7bf07-a7c8-44a3-8f14-68d997e60ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Volume volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e (dd1972c2-1da6-4f8e-9d20-0b106e57c97e): created successfully Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7bf07-a7c8-44a3-8f14-68d997e60ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Flow 'volume_create_manager' (5975a34a-e558-4854-b78c-d0028ee42747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9b5a5be0-3212-4b8c-acd9-f3de18c2e254 tempest-CinderUnicodeTest-2135706564 None] Created volume successfully. Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-b000afeb-9b17-4931-b7b3-b44cdad1beb1-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-b000afeb-9b17-4931-b7b3-b44cdad1beb1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-quobyte-b000afeb-9b17-4931-b7b3-b44cdad1beb1" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-b000afeb-9b17-4931-b7b3-b44cdad1beb1" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f9e2e6-7cdc-4b71-9e10-bec735e87f8b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:36 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 Nov 02 10:18:36 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Creating offline snapshot f6d28e7f-fa6f-4f8a-9662-a093933609b7 of volume dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55728b4-69b1-476a-8d46-052bf7413939]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:37 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e Nov 02 10:18:37 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:37 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:37 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1 Nov 02 10:18:37 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:37 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" returned: 0 in 0.357s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:37 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 1G Nov 02 10:18:37 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:37 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b000afeb-9b17-4931-b7b3-b44cdad1beb1" returned: 0 in 0.269s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-b000afeb-9b17-4931-b7b3-b44cdad1beb1" released by "delete_volume" :: held 0.717s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Created reservations ['ffad5c4e-32da-411e-9e7e-4a317a0711b8', '537f9830-1a33-48f7-883c-cba4ff9bb48a', 'cecd3fc6-a370-4ef3-a955-2fa9066b82b0', '5da43eca-1a92-40fa-a2b0-7d50b7e5ba1c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:37 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:37 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:37 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.267s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:37 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 1G" returned: 0 in 0.461s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:37 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Deleted volume successfully. Nov 02 10:18:37 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 Nov 02 10:18:37 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-b80f7639-6221-4421-bed9-c4025849cf63 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-b000afeb-9b17-4931-b7b3-b44cdad1beb1-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "cinder-quobyte-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" acquired by "delete_volume" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4788f0b-b692-4590-9b30-1e0c08cce217]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e Nov 02 10:18:38 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7" returned: 0 in 0.324s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:38 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 is being set with open permissions: ugo+rw Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 Nov 02 10:18:38 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" returned: 0 in 0.388s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e Nov 02 10:18:38 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7" returned: 0 in 0.262s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.info Nov 02 10:18:38 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-quobyte-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e" released by "delete_volume" :: held 0.681s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Created reservations ['efd14a48-943b-4e2b-9d94-16ee82e292e3', '15b1132a-83e7-40cc-9893-0134f520ba2c', '26eed42e-2485-4d30-9895-091e45a8608e', 'eacf7918-0313-42bb-808c-3bd82a58f715'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:38 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.info" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:38 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.info is being set with open permissions: ugo+rw Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.info Nov 02 10:18:38 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:38 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:39 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:39 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.238s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:39 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.info" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Deleted volume successfully. Nov 02 10:18:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2b5df200-5cf6-4b04-853a-f4041d311769 tempest-CinderUnicodeTest-2135706564 None] Create snapshot completed successfully Nov 02 10:18:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-22f7e47a-caa5-4663-a8ab-5b72af4b21a7 tempest-VolumeDependencyTests-2095455600 None] Lock "cinder-faf9f9bc-ee3f-49e9-9f4f-63ea8e39147e-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "cinder-f6d28e7f-fa6f-4f8a-9662-a093933609b7-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-f6d28e7f-fa6f-4f8a-9662-a093933609b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "cinder-quobyte-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "cinder-quobyte-f6d28e7f-fa6f-4f8a-9662-a093933609b7" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-f6d28e7f-fa6f-4f8a-9662-a093933609b7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Deleting offline snapshot f6d28e7f-fa6f-4f8a-9662-a093933609b7 of volume dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] snapshot_file for this snap is: volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5ced2a-2cd9-45b7-9e0a-dde1adc74423]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:40 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 Nov 02 10:18:40 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:40 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7" returned: 0 in 0.395s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbc74f5-e941-4acc-a60b-503508ad0221]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:40 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e Nov 02 10:18:40 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:41 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" returned: 0 in 0.387s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:41 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 Nov 02 10:18:41 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:41 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7" returned: 0 in 0.351s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:41 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7 Nov 02 10:18:41 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:41 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e.f6d28e7f-fa6f-4f8a-9662-a093933609b7" returned: 0 in 0.252s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-f6d28e7f-fa6f-4f8a-9662-a093933609b7" released by "_delete_snapshot" :: held 1.511s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" released by "delete_snapshot" :: held 1.538s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Created reservations ['da7578d8-d4b0-4127-beba-50528a450c8d', 'efc873a7-55e1-41a4-96c0-99f470034580', '4fa0486e-fd7d-48ac-a961-67df56b8b135', 'b8a5b08c-73e0-4a01-b9c9-a7d61db9bfbe'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:41 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Delete snapshot completed successfully. Nov 02 10:18:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8f25a0e9-cff0-4a64-8419-cfde1afe06c9 tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-f6d28e7f-fa6f-4f8a-9662-a093933609b7-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "cinder-dd1972c2-1da6-4f8e-9d20-0b106e57c97e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-dd1972c2-1da6-4f8e-9d20-0b106e57c97e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "cinder-quobyte-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" acquired by "delete_volume" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b519ad3d-c671-4e3b-b4d6-c9dc395f4720]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:42 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e Nov 02 10:18:42 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:42 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" returned: 0 in 0.359s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:42 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e Nov 02 10:18:42 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:43 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" returned: 0 in 0.272s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-dd1972c2-1da6-4f8e-9d20-0b106e57c97e" released by "delete_volume" :: held 0.708s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Created reservations ['9e46586b-afce-4838-b020-a56ff4c4c9cc', '8c071fdb-4eaa-41e6-8c57-9b66fefd1d3b', '043a27e9-fcef-4ea5-aad0-544fa91a02c2', 'a4a4b46f-a926-4929-86e0-8e4dc54ad9b4'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:43 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:43 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "cinder-3f51f2bb-b9c3-4529-a838-38b16ca6e205-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-3f51f2bb-b9c3-4529-a838-38b16ca6e205-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:43 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "cinder-quobyte-3f51f2bb-b9c3-4529-a838-38b16ca6e205" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.313s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-3f51f2bb-b9c3-4529-a838-38b16ca6e205" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:43 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Deleted volume successfully. Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b7a259-50ae-4a5b-b078-c751e669d2a9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60ed351b-cb94-4f12-82e4-15d116f391ad tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-dd1972c2-1da6-4f8e-9d20-0b106e57c97e-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:43 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 Nov 02 10:18:43 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:44 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:44 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205 Nov 02 10:18:44 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:44 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3f51f2bb-b9c3-4529-a838-38b16ca6e205" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-quobyte-3f51f2bb-b9c3-4529-a838-38b16ca6e205" released by "delete_volume" :: held 0.709s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Created reservations ['585329ef-4b0c-4e89-b1ea-47ee2b71e515', '13c20c64-da2c-4929-906a-9b30854b5041', '3e8c016c-f7da-4a31-87d8-0e9a3dd4e7d4', 'b2b741ec-e4d7-4fce-8220-0e19d6caac5b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:44 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:44 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:44 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.282s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:44 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Deleted volume successfully. Nov 02 10:18:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-30946d01-c3c8-4d58-8c6d-c462c01ee7be tempest-CinderUnicodeTest-2135706564 None] Lock "cinder-3f51f2bb-b9c3-4529-a838-38b16ca6e205-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:18:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:48 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:18:48 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:49 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:18:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:18:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:18:54 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=202,cinder:SELECT=149,cinder:DELETE=15,cinder:INSERT=52 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:18:54 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=145,cinder:UPDATE=201,cinder:INSERT=45,cinder:DELETE=19 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Flow 'volume_create_manager' (f7b6da23-d101-4a8e-9dcf-edc62c3ea6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b7a469-4d99-47d8-845d-3ccff499af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b7a469-4d99-47d8-845d-3ccff499af82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-213688730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157547df-dd24-4d55-ba19-d62f44dad038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c00ca2d74d445519811cfca9ac95161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:17Z,use_quota=True,user_id='2803eed7453c4bbfa30c8abc641413e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29abd990-e3c4-445b-af06-27830fb46a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29abd990-e3c4-445b-af06-27830fb46a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869478b1-aa51-4b70-9aff-3c6ad3113be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869478b1-aa51-4b70-9aff-3c6ad3113be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157547df-dd24-4d55-ba19-d62f44dad038', 'volume_name': 'volume-157547df-dd24-4d55-ba19-d62f44dad038', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acc3728-52da-41ba-a746-c8e709f89b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acc3728-52da-41ba-a746-c8e709f89b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876462de-93e2-4678-8178-6346ab3990d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Volume 157547df-dd24-4d55-ba19-d62f44dad038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157547df-dd24-4d55-ba19-d62f44dad038', 'volume_size': 1} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-213688730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157547df-dd24-4d55-ba19-d62f44dad038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c00ca2d74d445519811cfca9ac95161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:17Z,use_quota=True,user_id='2803eed7453c4bbfa30c8abc641413e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Creating volume 157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:17 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:17 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 1073741824 Nov 02 10:19:17 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:17 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 1073741824" returned: 0 in 0.418s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:17 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 Nov 02 10:19:17 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:17 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038" returned: 0 in 0.228s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876462de-93e2-4678-8178-6346ab3990d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157547df-dd24-4d55-ba19-d62f44dad038', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1d98b8-761a-4eae-8f20-9155a3bae19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Volume volume-157547df-dd24-4d55-ba19-d62f44dad038 (157547df-dd24-4d55-ba19-d62f44dad038): created successfully Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1d98b8-761a-4eae-8f20-9155a3bae19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Flow 'volume_create_manager' (f7b6da23-d101-4a8e-9dcf-edc62c3ea6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:17 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-13d0ee12-a900-4a08-b748-bc47d55e65f9 tempest-SnapshotDependencyTests-1641159072 None] Created volume successfully. Nov 02 10:19:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Creating offline snapshot bc08c85e-52cc-42cd-8e28-019e3ca4644f of volume 157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:19:18 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc4e92-6093-4fab-a81f-a2b88c78fe49]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:18 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 Nov 02 10:19:18 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:18 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038" returned: 0 in 0.345s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:18 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f 1G Nov 02 10:19:18 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:19 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f 1G" returned: 0 in 0.397s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157547df-dd24-4d55-ba19-d62f44dad038 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:19 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157547df-dd24-4d55-ba19-d62f44dad038 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f Nov 02 10:19:19 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:19 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157547df-dd24-4d55-ba19-d62f44dad038 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f" returned: 0 in 0.278s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:19 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f is being set with open permissions: ugo+rw Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:19 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f Nov 02 10:19:19 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:19 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f" returned: 0 in 0.236s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:19 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.info Nov 02 10:19:19 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:19 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.info" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:19 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.info is being set with open permissions: ugo+rw Nov 02 10:19:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:19 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.info Nov 02 10:19:19 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:20 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.info" returned: 0 in 0.232s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a216e5ea-df7c-482a-a0b1-a9b4a947c034 tempest-SnapshotDependencyTests-1641159072 None] Create snapshot completed successfully Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Flow 'volume_create_manager' (d97a6c25-23a0-4736-b1e0-629264f0789d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd0544-929a-4e19-bd3a-b37baaa184ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd0544-929a-4e19-bd3a-b37baaa184ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0375bf36-53d1-4889-9dc9-817924fa22a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c00ca2d74d445519811cfca9ac95161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc08c85e-52cc-42cd-8e28-019e3ca4644f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:21Z,use_quota=True,user_id='2803eed7453c4bbfa30c8abc641413e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a1ddc2-33b1-49c3-b64b-2d0db195b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a1ddc2-33b1-49c3-b64b-2d0db195b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a4b6fe-9b41-4297-804e-27c521aad4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a4b6fe-9b41-4297-804e-27c521aad4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0375bf36-53d1-4889-9dc9-817924fa22a2', 'volume_name': 'volume-0375bf36-53d1-4889-9dc9-817924fa22a2', 'volume_size': 1, 'snapshot_id': 'bc08c85e-52cc-42cd-8e28-019e3ca4644f'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051ba82f-7725-4ea9-b17f-1dcc433543c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051ba82f-7725-4ea9-b17f-1dcc433543c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35f492-d057-4de2-b8ed-3cb1023a9578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Volume 0375bf36-53d1-4889-9dc9-817924fa22a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0375bf36-53d1-4889-9dc9-817924fa22a2', 'volume_size': 1, 'snapshot_id': 'bc08c85e-52cc-42cd-8e28-019e3ca4644f'} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-quobyte-bc08c85e-52cc-42cd-8e28-019e3ca4644f-0375bf36-53d1-4889-9dc9-817924fa22a2" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-bc08c85e-52cc-42cd-8e28-019e3ca4644f-0375bf36-53d1-4889-9dc9-817924fa22a2" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Creating volume 0375bf36-53d1-4889-9dc9-817924fa22a2 from snapshot bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-quobyte-0375bf36-53d1-4889-9dc9-817924fa22a2" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-0375bf36-53d1-4889-9dc9-817924fa22a2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] snapshot: bc08c85e-52cc-42cd-8e28-019e3ca4644f, volume: 0375bf36-53d1-4889-9dc9-817924fa22a2, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff79847-229b-4ed2-b3a7-fd7b075c6f42]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:21 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f Nov 02 10:19:21 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:21 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f" returned: 0 in 0.347s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157547df-dd24-4d55-ba19-d62f44dad038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[02703204-2a8e-4eb8-8111-4c6cc1081183]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:21 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 Nov 02 10:19:21 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:21 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038" returned: 0 in 0.343s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:19:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:21 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 Nov 02 10:19:21 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:27 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2" returned: 0 in 5.587s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:19:27 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Converted 1024.00 MB image at 183.24 MB/s Nov 02 10:19:27 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 is being set with open permissions: ugo+rw Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:27 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 Nov 02 10:19:27 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:27 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2" returned: 0 in 0.224s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-0375bf36-53d1-4889-9dc9-817924fa22a2" released by "_copy_volume_from_snapshot" :: held 6.585s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-bc08c85e-52cc-42cd-8e28-019e3ca4644f-0375bf36-53d1-4889-9dc9-817924fa22a2" released by "_create_volume_from_snapshot" :: held 6.645s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.659s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35f492-d057-4de2-b8ed-3cb1023a9578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0375bf36-53d1-4889-9dc9-817924fa22a2', 'volume_size': 1, 'snapshot_id': 'bc08c85e-52cc-42cd-8e28-019e3ca4644f'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934f3498-64ea-499b-9fc5-06539b8c09fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:27 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Volume volume-0375bf36-53d1-4889-9dc9-817924fa22a2 (0375bf36-53d1-4889-9dc9-817924fa22a2): created successfully Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934f3498-64ea-499b-9fc5-06539b8c09fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:27 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Flow 'volume_create_manager' (d97a6c25-23a0-4736-b1e0-629264f0789d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-60d3a57b-1e41-4d87-a491-2c78aa7ccd30 tempest-SnapshotDependencyTests-1641159072 None] Created volume successfully. Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-bc08c85e-52cc-42cd-8e28-019e3ca4644f-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-bc08c85e-52cc-42cd-8e28-019e3ca4644f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-quobyte-157547df-dd24-4d55-ba19-d62f44dad038" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-157547df-dd24-4d55-ba19-d62f44dad038" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-quobyte-bc08c85e-52cc-42cd-8e28-019e3ca4644f" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-bc08c85e-52cc-42cd-8e28-019e3ca4644f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Deleting offline snapshot bc08c85e-52cc-42cd-8e28-019e3ca4644f of volume 157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] snapshot_file for this snap is: volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac2be19-00f6-428e-a717-1047c1a7a5cb]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:28 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f Nov 02 10:19:28 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:29 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157547df-dd24-4d55-ba19-d62f44dad038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647b5a2-8a12-48e0-94c2-382754fe4991]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:29 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 Nov 02 10:19:29 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:29 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038" returned: 0 in 0.511s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:29 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f Nov 02 10:19:29 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:29 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f" returned: 0 in 0.321s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:29 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f Nov 02 10:19:29 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:30 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038.bc08c85e-52cc-42cd-8e28-019e3ca4644f" returned: 0 in 0.236s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-bc08c85e-52cc-42cd-8e28-019e3ca4644f" released by "_delete_snapshot" :: held 1.547s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-157547df-dd24-4d55-ba19-d62f44dad038" released by "delete_snapshot" :: held 1.567s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Created reservations ['b86d9bbc-33c2-4572-a497-cf9f92f76c10', '30fc3331-7d83-4636-a1b1-b9e2b741fb3b', 'ac5c5eaf-6c07-48c3-a754-15a0c829ee83', '42956591-dcc7-4d2c-b174-57c666f5b1f2'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Delete snapshot completed successfully. Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a765ef1f-43f4-4356-9bdb-a26a9eb9ec28 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-bc08c85e-52cc-42cd-8e28-019e3ca4644f-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-157547df-dd24-4d55-ba19-d62f44dad038-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-157547df-dd24-4d55-ba19-d62f44dad038-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-quobyte-157547df-dd24-4d55-ba19-d62f44dad038" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-157547df-dd24-4d55-ba19-d62f44dad038" acquired by "delete_volume" :: waited 0.013s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d52508a-ecb5-433e-8200-b08b8a79adb3]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:31 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 Nov 02 10:19:31 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038" returned: 0 in 0.364s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:31 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038 Nov 02 10:19:31 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-157547df-dd24-4d55-ba19-d62f44dad038" returned: 0 in 0.252s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-157547df-dd24-4d55-ba19-d62f44dad038" released by "delete_volume" :: held 0.679s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Created reservations ['9bb8262b-e16a-4e5f-a80c-5bf29edbc96d', 'a391839d-469f-48eb-8cc8-62abd8fe57a5', '0101c880-c7bc-4134-af21-e02414f1e526', 'c8087144-616b-4714-ab57-018b82f5e34c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:31 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:19:31 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.239s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Deleted volume successfully. Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-76ef51c9-3116-40b7-9ea9-974ca4fb1a70 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-157547df-dd24-4d55-ba19-d62f44dad038-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-0375bf36-53d1-4889-9dc9-817924fa22a2-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-0375bf36-53d1-4889-9dc9-817924fa22a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "cinder-quobyte-0375bf36-53d1-4889-9dc9-817924fa22a2" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-0375bf36-53d1-4889-9dc9-817924fa22a2" acquired by "delete_volume" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db0229e-8605-4a3f-bea4-07f7925a7846]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:32 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 Nov 02 10:19:32 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:32 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:32 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2 Nov 02 10:19:32 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:32 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-0375bf36-53d1-4889-9dc9-817924fa22a2" returned: 0 in 0.250s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-quobyte-0375bf36-53d1-4889-9dc9-817924fa22a2" released by "delete_volume" :: held 0.657s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Created reservations ['40e2bdb6-49eb-4e76-99ce-e5692d298903', '1445bcc4-28b2-4972-8b4d-33679a6c5045', '4f54ee56-9ca1-4605-9b59-4428a2d00cb9', '639c3035-b72b-49e1-82f5-313ace3ee6a7'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:32 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:19:32 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:33 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.237s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:33 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Deleted volume successfully. Nov 02 10:19:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-976040a6-2ccf-4333-a120-832f703fd737 tempest-SnapshotDependencyTests-1641159072 None] Lock "cinder-0375bf36-53d1-4889-9dc9-817924fa22a2-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:42 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=30,cinder:SELECT=27,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:19:43 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:19:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:19:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:48 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:19:48 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:49 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.286s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:19:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:19:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (66358961-ebc5-4202-a47a-c57310238a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973a4d7a-55dd-48d9-a8d9-414066d5e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973a4d7a-55dd-48d9-a8d9-414066d5e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073947906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9634af-5fcb-452c-9672-e12f5e5ba041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:55Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff365da-458e-40bc-906a-ba18353cb796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff365da-458e-40bc-906a-ba18353cb796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001832c9-20c8-45dd-aa98-cfd1f67c2aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001832c9-20c8-45dd-aa98-cfd1f67c2aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9634af-5fcb-452c-9672-e12f5e5ba041', 'volume_name': 'volume-3c9634af-5fcb-452c-9672-e12f5e5ba041', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c515af2d-d5f1-44d2-944c-efc23cfff83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c515af2d-d5f1-44d2-944c-efc23cfff83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a09da2-bcd5-4faf-8019-be71036ec3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume 3c9634af-5fcb-452c-9672-e12f5e5ba041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9634af-5fcb-452c-9672-e12f5e5ba041', 'volume_size': 1} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073947906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9634af-5fcb-452c-9672-e12f5e5ba041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:55Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Creating volume 3c9634af-5fcb-452c-9672-e12f5e5ba041 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:55 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:55 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 1073741824 Nov 02 10:19:55 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (d33b76f4-0a39-43c6-880e-dc2ba7332d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd2db18-54d7-4393-96b5-b83304a2cc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd2db18-54d7-4393-96b5-b83304a2cc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509966910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:55Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1890f81-3086-42e0-a6b3-dc1ec38b0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1890f81-3086-42e0-a6b3-dc1ec38b0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a609fbe5-acf5-4d1f-9add-f7faca5f1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a609fbe5-acf5-4d1f-9add-f7faca5f1039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b', 'volume_name': 'volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f6c408-4aa6-4f6c-a577-a348d6b2fedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f6c408-4aa6-4f6c-a577-a348d6b2fedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fcdeba-b2e6-416a-818b-bf4e9e4ba066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:55 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b', 'volume_size': 1} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:55 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 1073741824" returned: 0 in 0.518s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:55 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 Nov 02 10:19:55 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:55 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041" returned: 0 in 0.278s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509966910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:55Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Creating volume aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:55 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a09da2-bcd5-4faf-8019-be71036ec3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9634af-5fcb-452c-9672-e12f5e5ba041', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05708fed-28e9-4cc1-b5f3-da4cf386164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:55 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b 1073741824 Nov 02 10:19:55 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:55 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 (3c9634af-5fcb-452c-9672-e12f5e5ba041): created successfully Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05708fed-28e9-4cc1-b5f3-da4cf386164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (66358961-ebc5-4202-a47a-c57310238a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-de9da00f-7cfc-41ad-a4fc-53deb0823643 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created volume successfully. Nov 02 10:19:56 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b 1073741824" returned: 0 in 0.551s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:56 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b Nov 02 10:19:56 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:56 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" returned: 0 in 0.323s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fcdeba-b2e6-416a-818b-bf4e9e4ba066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c92ed-d1e6-4db6-be19-5ccecd68d64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:56 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b (aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b): created successfully Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c92ed-d1e6-4db6-be19-5ccecd68d64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (d33b76f4-0a39-43c6-880e-dc2ba7332d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:56 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-24cddcca-4255-45ac-85ea-d48b5cfc468a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created volume successfully. Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (9427849a-53d2-4387-89ef-241365967097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e621d-4a39-43bf-a1a6-87eda019c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e621d-4a39-43bf-a1a6-87eda019c599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71190417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b32695-f2d0-4f77-9770-ba8e461bd851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:57Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664fab15-2e93-4bf7-bc2e-448f75bba6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664fab15-2e93-4bf7-bc2e-448f75bba6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd64843f-7608-401f-b8ce-ab2cbf1f30bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd64843f-7608-401f-b8ce-ab2cbf1f30bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b32695-f2d0-4f77-9770-ba8e461bd851', 'volume_name': 'volume-81b32695-f2d0-4f77-9770-ba8e461bd851', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a1d87e-e0b6-46c4-9145-adbf6f0814db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a1d87e-e0b6-46c4-9145-adbf6f0814db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372f8316-0e77-4229-928d-1242b81faaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:57 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume 81b32695-f2d0-4f77-9770-ba8e461bd851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b32695-f2d0-4f77-9770-ba8e461bd851', 'volume_size': 1} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71190417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b32695-f2d0-4f77-9770-ba8e461bd851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:57Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Creating volume 81b32695-f2d0-4f77-9770-ba8e461bd851 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:57 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:57 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 1073741824 Nov 02 10:19:57 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (c6c90850-b26d-4e86-b9c8-a88ad1720603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc72361-f894-44fe-86c2-60bf2547d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc72361-f894-44fe-86c2-60bf2547d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262905866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac615934-235d-49e0-bad6-807eb8dc067c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:58Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c535d-69b5-4aa7-8158-58a5f22d3692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c535d-69b5-4aa7-8158-58a5f22d3692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd84cae-aee1-4348-8d09-f7c5e7b5a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd84cae-aee1-4348-8d09-f7c5e7b5a420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac615934-235d-49e0-bad6-807eb8dc067c', 'volume_name': 'volume-ac615934-235d-49e0-bad6-807eb8dc067c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be914d55-6f08-46b6-bbee-c2d997f75d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be914d55-6f08-46b6-bbee-c2d997f75d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad395737-e15f-4407-9cc8-142080e9b70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume ac615934-235d-49e0-bad6-807eb8dc067c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac615934-235d-49e0-bad6-807eb8dc067c', 'volume_size': 1} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:58 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 1073741824" returned: 0 in 0.783s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (16310f62-48e6-4b83-a415-b312fbcf7c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55cdfcd-a1e7-4214-bc30-f1026309a2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55cdfcd-a1e7-4214-bc30-f1026309a2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913484255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee5a68a-8410-40b1-a675-dff748ac41be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:58Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f782fb2-78b8-42c4-b5ee-c46fd2297623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f782fb2-78b8-42c4-b5ee-c46fd2297623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e40e0a-950e-43cf-80d6-73f39089043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e40e0a-950e-43cf-80d6-73f39089043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee5a68a-8410-40b1-a675-dff748ac41be', 'volume_name': 'volume-4ee5a68a-8410-40b1-a675-dff748ac41be', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df9c3de-27b3-4723-8ab2-19ac3637f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df9c3de-27b3-4723-8ab2-19ac3637f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae4bc4f-7bfc-462e-a577-e9abc136acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:58 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume 4ee5a68a-8410-40b1-a675-dff748ac41be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee5a68a-8410-40b1-a675-dff748ac41be', 'volume_size': 1} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:58 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 Nov 02 10:19:58 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:58 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (158cf872-68d2-4eed-b913-8b13ed66241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8a0702-dbfa-456a-977c-dadec5982b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851" returned: 0 in 0.489s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262905866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac615934-235d-49e0-bad6-807eb8dc067c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:58Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Creating volume ac615934-235d-49e0-bad6-807eb8dc067c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:59 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8a0702-dbfa-456a-977c-dadec5982b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139292187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce80c394-a931-4ea3-b3f9-21335c29fe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:59Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b9369-937d-458c-894b-36ea08c20d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b9369-937d-458c-894b-36ea08c20d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c 1073741824 Nov 02 10:19:59 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21db57-3621-4dfa-9cea-a7acba58c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21db57-3621-4dfa-9cea-a7acba58c874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce80c394-a931-4ea3-b3f9-21335c29fe1f', 'volume_name': 'volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e85bedb-c90f-4025-9359-482184730490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e85bedb-c90f-4025-9359-482184730490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2876cabf-8dd8-48ac-b2c9-4bfd5ddf117c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume ce80c394-a931-4ea3-b3f9-21335c29fe1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f', 'volume_size': 1} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372f8316-0e77-4229-928d-1242b81faaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b32695-f2d0-4f77-9770-ba8e461bd851', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319a8494-3563-4cf7-a55b-9b106ce62962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume volume-81b32695-f2d0-4f77-9770-ba8e461bd851 (81b32695-f2d0-4f77-9770-ba8e461bd851): created successfully Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319a8494-3563-4cf7-a55b-9b106ce62962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (9427849a-53d2-4387-89ef-241365967097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:59 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e6848582-51e4-4c22-9eee-7516c042c6e7 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created volume successfully. Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (64b65e01-4a8a-4f14-8ab0-fee01c6beaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5836da-679f-4ead-a625-d4e0e158d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5836da-679f-4ead-a625-d4e0e158d682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797010966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639869c0-315e-495f-9aa8-f20d7a9cbe19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:59Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099e1ceb-f0ef-49f2-892c-1679055387e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099e1ceb-f0ef-49f2-892c-1679055387e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50ea839-ad83-42af-b033-faac1adf7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50ea839-ad83-42af-b033-faac1adf7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639869c0-315e-495f-9aa8-f20d7a9cbe19', 'volume_name': 'volume-639869c0-315e-495f-9aa8-f20d7a9cbe19', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf007d3-626c-4011-954f-12a2ef04a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf007d3-626c-4011-954f-12a2ef04a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13113ec-aa18-4164-be83-ac52712c6735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume 639869c0-315e-495f-9aa8-f20d7a9cbe19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639869c0-315e-495f-9aa8-f20d7a9cbe19', 'volume_size': 1} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:59 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c 1073741824" returned: 0 in 0.598s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:59 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c Nov 02 10:19:59 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:59 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c" returned: 0 in 0.257s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913484255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee5a68a-8410-40b1-a675-dff748ac41be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:58Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Creating volume 4ee5a68a-8410-40b1-a675-dff748ac41be {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:59 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad395737-e15f-4407-9cc8-142080e9b70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac615934-235d-49e0-bad6-807eb8dc067c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be 1073741824 Nov 02 10:19:59 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847a8cc0-a35d-47ca-9eeb-f655bb7896a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume volume-ac615934-235d-49e0-bad6-807eb8dc067c (ac615934-235d-49e0-bad6-807eb8dc067c): created successfully Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847a8cc0-a35d-47ca-9eeb-f655bb7896a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (c6c90850-b26d-4e86-b9c8-a88ad1720603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ca0cb62a-f8b9-4650-b4f2-11b7679587c5 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created volume successfully. Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Flow 'volume_create_manager' (a1ae1218-22c3-4ded-a5b9-c2b8d00c390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7901e11-f779-4c90-a320-7f3a7e2a4378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7901e11-f779-4c90-a320-7f3a7e2a4378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffbf5f9-9150-4b7c-81dd-f4c60dc725cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115ada5f3eb849029cf2c8650a1f70b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:00Z,use_quota=True,user_id='9974aa82a2eb4f0bb0abe273fd2b4691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbf19090-75b6-40c4-be91-52257b1f1946),volume_type_id=cbf19090-75b6-40c4-be91-52257b1f1946)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7a53b2-0d5d-4140-b34a-c1ccc31f4175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7a53b2-0d5d-4140-b34a-c1ccc31f4175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4621c7-90bb-4eca-bea1-c8881f4e600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:20:00 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be 1073741824" returned: 0 in 0.608s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:00 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be Nov 02 10:20:00 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:00 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be" returned: 0 in 0.301s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.371s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae4bc4f-7bfc-462e-a577-e9abc136acda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee5a68a-8410-40b1-a675-dff748ac41be', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fba6f4c-bcb2-4f7d-ba36-0976828b515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Creating offline snapshot aef4d110-d601-4203-afc0-b42eacdd7556 of volume aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4621c7-90bb-4eca-bea1-c8881f4e600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fffbf5f9-9150-4b7c-81dd-f4c60dc725cc', 'volume_name': 'volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc', 'volume_size': 1, 'image_id': '5134925f-da1c-4db2-8485-be28110812bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5134925f-da1c-4db2-8485-be28110812bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '202974f436a3fb78a9a78b9024fb4d2d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '115ada5f3eb849029cf2c8650a1f70b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b39f19d1521722c7d2af1b8aaae2a22c7f7f5672020a70121fdcbdfe66522eb48b7ef4133e0656f540d79ce46b8ea54a12d61612da10446c9922cf0ed39e57c', 'id': '5134925f-da1c-4db2-8485-be28110812bb', 'created_at': datetime.datetime(2026, 11, 2, 9, 19, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5134925f-da1c-4db2-8485-be28110812bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe06d64c-3a4e-4119-9cca-d4c9e917866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe06d64c-3a4e-4119-9cca-d4c9e917866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e825e9-e4cc-42f2-b2d3-a8cbd38cdb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:01 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Volume fffbf5f9-9150-4b7c-81dd-f4c60dc725cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc', 'volume_size': 1, 'image_id': '5134925f-da1c-4db2-8485-be28110812bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5134925f-da1c-4db2-8485-be28110812bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '202974f436a3fb78a9a78b9024fb4d2d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '115ada5f3eb849029cf2c8650a1f70b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b39f19d1521722c7d2af1b8aaae2a22c7f7f5672020a70121fdcbdfe66522eb48b7ef4133e0656f540d79ce46b8ea54a12d61612da10446c9922cf0ed39e57c', 'id': '5134925f-da1c-4db2-8485-be28110812bb', 'created_at': datetime.datetime(2026, 11, 2, 9, 19, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5134925f-da1c-4db2-8485-be28110812bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Trying to clone fffbf5f9-9150-4b7c-81dd-f4c60dc725cc from image 5134925f-da1c-4db2-8485-be28110812bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5134925f-da1c-4db2-8485-be28110812bb', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:20:01 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume volume-4ee5a68a-8410-40b1-a675-dff748ac41be (4ee5a68a-8410-40b1-a675-dff748ac41be): created successfully Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fba6f4c-bcb2-4f7d-ba36-0976828b515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (16310f62-48e6-4b83-a415-b312fbcf7c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4b8a5c-0fbe-4cb2-82ce-598679450f1b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-dc1eb4df-85d6-46ec-9b49-32b468348656 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created volume successfully. Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:20:01 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:20:01 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b Nov 02 10:20:01 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786614c-ea63-4d86-9c4f-be987086b702]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:01 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD Nov 02 10:20:01 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:01 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" returned: 0 in 0.445s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:01 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 1G Nov 02 10:20:01 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:01 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:01 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD Nov 02 10:20:01 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:01 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:02 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:02 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (0d17d514-e131-4fad-98c2-443f12fa9d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91890752-62be-48be-b017-4c1ea3c4ca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 1G" returned: 0 in 0.563s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Temporary image 5134925f-da1c-4db2-8485-be28110812bb is fetched for user 9974aa82a2eb4f0bb0abe273fd2b4691. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:02 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 Nov 02 10:20:02 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91890752-62be-48be-b017-4c1ea3c4ca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55987007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41f319c-c4b6-4d3b-819f-6c5359ce3ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:02Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28901fc-3ced-4489-b13a-b61b1f23b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28901fc-3ced-4489-b13a-b61b1f23b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918919a2-33cb-4c20-baff-e4cd65ba52aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918919a2-33cb-4c20-baff-e4cd65ba52aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41f319c-c4b6-4d3b-819f-6c5359ce3ca7', 'volume_name': 'volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f165df43-d4d6-4c0a-9a0e-9adf59735bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f165df43-d4d6-4c0a-9a0e-9adf59735bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fc54af-aa27-4f67-ac6d-26c73118de39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:02 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Volume a41f319c-c4b6-4d3b-819f-6c5359ce3ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7', 'volume_size': 1} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[151d121e-5cb7-42f5-aefa-e5a2cfdc1250]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:02 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD Nov 02 10:20:02 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:02 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556" returned: 0 in 0.299s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:02 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 is being set with open permissions: ugo+rw Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:02 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 Nov 02 10:20:02 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:02 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:02 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556" returned: 0 in 0.258s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:02 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD Nov 02 10:20:02 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:02 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.info Nov 02 10:20:02 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:02 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:02 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.info" returned: 0 in 0.262s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:02 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.info is being set with open permissions: ugo+rw Nov 02 10:20:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:02 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.info Nov 02 10:20:02 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:03 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.info" returned: 0 in 0.243s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.046s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139292187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce80c394-a931-4ea3-b3f9-21335c29fe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:59Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Creating volume ce80c394-a931-4ea3-b3f9-21335c29fe1f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:03 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:03 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f 1073741824 Nov 02 10:20:03 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a8182b40-582a-4c05-96be-111f84f1588c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Create snapshot completed successfully Nov 02 10:20:03 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f 1073741824" returned: 0 in 0.435s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:03 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f Nov 02 10:20:03 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:03 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.353s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797010966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639869c0-315e-495f-9aa8-f20d7a9cbe19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdf9a1712764c04a837b2ffb7d1a42f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:59Z,use_quota=True,user_id='8f8f601b252341ffb17616e128958865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Creating volume 639869c0-315e-495f-9aa8-f20d7a9cbe19 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:03 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2876cabf-8dd8-48ac-b2c9-4bfd5ddf117c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:03 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 1073741824 Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89b48fd-1889-45e1-8c10-c2c25aa7c56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:03 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:03 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f (ce80c394-a931-4ea3-b3f9-21335c29fe1f): created successfully Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89b48fd-1889-45e1-8c10-c2c25aa7c56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (158cf872-68d2-4eed-b913-8b13ed66241c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:04 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6bce30b7-9800-4cd1-8fe5-d030d95fcfdd tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created volume successfully. Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (89c21f3f-65c8-4466-99be-7e5ac4b59060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca31eee-d4f4-4ca1-9c11-09a5e6cd46fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca31eee-d4f4-4ca1-9c11-09a5e6cd46fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349919123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed95ae0a-b52e-45ea-b14d-454507e72d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:04Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed321a92-5a57-43cb-93c8-7a818b35a564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed321a92-5a57-43cb-93c8-7a818b35a564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc106c4a-d1c5-4749-ab21-62fb38cf4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc106c4a-d1c5-4749-ab21-62fb38cf4307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed95ae0a-b52e-45ea-b14d-454507e72d0c', 'volume_name': 'volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde6001-13c6-416c-94a6-fd31bb1a2567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde6001-13c6-416c-94a6-fd31bb1a2567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0694959f-0a04-481f-beea-d247fad4c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume ed95ae0a-b52e-45ea-b14d-454507e72d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c', 'volume_size': 1} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:04 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 1073741824" returned: 0 in 0.560s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:04 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 Nov 02 10:20:04 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (2f3c6827-e472-4e93-90bd-f51ea2cb16ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5192dfa2-25ea-411d-b25c-7d5714ad884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5192dfa2-25ea-411d-b25c-7d5714ad884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182675139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6d441d-d587-4a1a-9445-be2fce3f317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:05Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf0f289-c37d-4d32-a900-b2c95d49c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf0f289-c37d-4d32-a900-b2c95d49c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b207344f-a87b-4fb5-8256-94339cdc68ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b207344f-a87b-4fb5-8256-94339cdc68ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6d441d-d587-4a1a-9445-be2fce3f317f', 'volume_name': 'volume-3b6d441d-d587-4a1a-9445-be2fce3f317f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38e2f53-633b-4462-8a7f-1744945c54c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38e2f53-633b-4462-8a7f-1744945c54c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44315ae-87b2-4b2c-9afe-01c665d6c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume 3b6d441d-d587-4a1a-9445-be2fce3f317f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6d441d-d587-4a1a-9445-be2fce3f317f', 'volume_size': 1} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:04 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19" returned: 0 in 0.260s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.688s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55987007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41f319c-c4b6-4d3b-819f-6c5359ce3ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:02Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Creating volume a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:04 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13113ec-aa18-4164-be83-ac52712c6735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639869c0-315e-495f-9aa8-f20d7a9cbe19', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a791f8b-610b-422d-9b92-b74e59792756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:04 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 1073741824 Nov 02 10:20:04 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:04 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Volume volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 (639869c0-315e-495f-9aa8-f20d7a9cbe19): created successfully Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a791f8b-610b-422d-9b92-b74e59792756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:04 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Flow 'volume_create_manager' (64b65e01-4a8a-4f14-8ab0-fee01c6beaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:04 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5de15bbe-116b-4fbc-a38b-4d9f8f680a4e tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created volume successfully. Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (5a8d623b-0acc-4e81-8ce5-142ec576b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cc1c9e-eb65-4eca-a5fd-0749f5e807f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-639869c0-315e-495f-9aa8-f20d7a9cbe19-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cc1c9e-eb65-4eca-a5fd-0749f5e807f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-218073610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88071f55-b96b-4360-b130-69d30f13948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:05Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1359af0c-6169-4073-b50c-eec0e35465b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1359af0c-6169-4073-b50c-eec0e35465b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a6415-8b83-4bed-88ed-8bb32ed78a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a6415-8b83-4bed-88ed-8bb32ed78a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88071f55-b96b-4360-b130-69d30f13948a', 'volume_name': 'volume-88071f55-b96b-4360-b130-69d30f13948a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67866d36-0dac-4db9-9f66-b77fe83f02e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67866d36-0dac-4db9-9f66-b77fe83f02e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1f9f1e-1467-48ea-a80f-625d73e6ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume 88071f55-b96b-4360-b130-69d30f13948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88071f55-b96b-4360-b130-69d30f13948a', 'volume_size': 1} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-639869c0-315e-495f-9aa8-f20d7a9cbe19-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-quobyte-639869c0-315e-495f-9aa8-f20d7a9cbe19" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-639869c0-315e-495f-9aa8-f20d7a9cbe19" acquired by "delete_volume" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b62bb71-5b63-44dd-ba7e-3543854a3e56]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:05 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 Nov 02 10:20:05 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (de268b48-05df-4a65-b28c-9c198041fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1203f1-a7b7-4c57-8b46-b67d6639ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 1073741824" returned: 0 in 0.724s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1203f1-a7b7-4c57-8b46-b67d6639ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955461971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280c28bf-3424-46ae-9a35-4aea028980d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:05Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed564f47-b8d8-4237-811d-58e3a31f66da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed564f47-b8d8-4237-811d-58e3a31f66da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f62b7b-f4f5-41bd-ab48-cf480fd48fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f62b7b-f4f5-41bd-ab48-cf480fd48fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280c28bf-3424-46ae-9a35-4aea028980d8', 'volume_name': 'volume-280c28bf-3424-46ae-9a35-4aea028980d8', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5346eda1-9111-443e-88fb-b96c5d24ef62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5346eda1-9111-443e-88fb-b96c5d24ef62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ffafa6-d0f4-4f51-be0e-a37e9171893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume 280c28bf-3424-46ae-9a35-4aea028980d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280c28bf-3424-46ae-9a35-4aea028980d8', 'volume_size': 1} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:05 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 Nov 02 10:20:05 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:05 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19" returned: 0 in 0.437s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:05 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19 Nov 02 10:20:05 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:05 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (c72b042a-881e-4962-a2fd-733af993d7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f029c58-6d58-4d30-bec1-1ab03e28ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" returned: 0 in 0.286s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.061s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffbf5f9-9150-4b7c-81dd-f4c60dc725cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115ada5f3eb849029cf2c8650a1f70b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:00Z,use_quota=True,user_id='9974aa82a2eb4f0bb0abe273fd2b4691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbf19090-75b6-40c4-be91-52257b1f1946),volume_type_id=cbf19090-75b6-40c4-be91-52257b1f1946)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Creating volume fffbf5f9-9150-4b7c-81dd-f4c60dc725cc {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:05 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f029c58-6d58-4d30-bec1-1ab03e28ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135463014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463495f4-0ec2-4b6d-a23a-0d905c86606e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:06Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc 1073741824 Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449bc274-4812-4380-8e15-46e663babe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449bc274-4812-4380-8e15-46e663babe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de35bc99-aaf6-4401-ab68-46cc2c7eac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de35bc99-aaf6-4401-ab68-46cc2c7eac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463495f4-0ec2-4b6d-a23a-0d905c86606e', 'volume_name': 'volume-463495f4-0ec2-4b6d-a23a-0d905c86606e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbc014c-2251-4c4a-bed5-b3266165e734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbc014c-2251-4c4a-bed5-b3266165e734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26519813-0f80-48a8-b278-c748a2906999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:05 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume 463495f4-0ec2-4b6d-a23a-0d905c86606e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463495f4-0ec2-4b6d-a23a-0d905c86606e', 'volume_size': 1} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:05 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fc54af-aa27-4f67-ac6d-26c73118de39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a6aa63-5222-4c52-bdbc-cfd0eb779abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:06 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Volume volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 (a41f319c-c4b6-4d3b-819f-6c5359ce3ca7): created successfully Nov 02 10:20:06 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a6aa63-5222-4c52-bdbc-cfd0eb779abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (0d17d514-e131-4fad-98c2-443f12fa9d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-639869c0-315e-495f-9aa8-f20d7a9cbe19" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-639869c0-315e-495f-9aa8-f20d7a9cbe19" released by "delete_volume" :: held 0.758s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c03b8fb7-6b1f-44df-853d-2ae1d5cf3269 tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created reservations ['7fdd9eeb-f5c5-42ac-89fd-9babc5799bd5', 'c38acea7-9fa4-485e-b1b1-b1f1c505c7cc', '4b09a019-a3f7-44c5-9076-be588f962af0', '5e209743-c690-4f85-a0bb-de6181e2e2eb'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:06 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:06 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-ce80c394-a931-4ea3-b3f9-21335c29fe1f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-ce80c394-a931-4ea3-b3f9-21335c29fe1f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:06 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.278s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-quobyte-ce80c394-a931-4ea3-b3f9-21335c29fe1f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Deleted volume successfully. Nov 02 10:20:06 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3f56316-ffbf-4aea-86b6-3aedf754d9ce tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-639869c0-315e-495f-9aa8-f20d7a9cbe19-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-ce80c394-a931-4ea3-b3f9-21335c29fe1f" acquired by "delete_volume" :: waited 0.046s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc 1073741824" returned: 0 in 0.594s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b461473-60d1-44b3-8f81-94dd17ee4f99]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:06 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc Nov 02 10:20:06 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:06 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f Nov 02 10:20:06 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:06 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc" returned: 0 in 0.286s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.557s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349919123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed95ae0a-b52e-45ea-b14d-454507e72d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:04Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Creating volume ed95ae0a-b52e-45ea-b14d-454507e72d0c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:06 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:06 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c 1073741824 Nov 02 10:20:06 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Attempting download of 5134925f-da1c-4db2-8485-be28110812bb ((None, [{'url': 'file:///opt/stack/data/glance/images/5134925f-da1c-4db2-8485-be28110812bb', 'metadata': {}}])) to volume fffbf5f9-9150-4b7c-81dd-f4c60dc725cc. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93ab22d-4412-45a1-90ae-e1e3c50347b0]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5134925f-da1c-4db2-8485-be28110812bb_sey57hs7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:06 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f" returned: 0 in 0.451s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f Nov 02 10:20:07 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5134925f-da1c-4db2-8485-be28110812bb_sey57hs7 Nov 02 10:20:07 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce80c394-a931-4ea3-b3f9-21335c29fe1f" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-ce80c394-a931-4ea3-b3f9-21335c29fe1f" released by "delete_volume" :: held 0.781s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:07 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5134925f-da1c-4db2-8485-be28110812bb_sey57hs7" returned: 0 in 0.372s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5134925f-da1c-4db2-8485-be28110812bb_sey57hs7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c 1073741824" returned: 0 in 0.484s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created reservations ['6c7b3000-52b8-4ba0-99b9-a30c88c28ea3', 'a7eff993-b945-479a-b181-fe0eaa7f8541', '3a000450-aa51-4569-b8c1-09ffb20ddc95', '508f2016-6a0d-4cb8-99ab-052b55cd8b6f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c Nov 02 10:20:07 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5134925f-da1c-4db2-8485-be28110812bb_sey57hs7 Nov 02 10:20:07 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:07 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-4ee5a68a-8410-40b1-a675-dff748ac41be-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-4ee5a68a-8410-40b1-a675-dff748ac41be-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-quobyte-4ee5a68a-8410-40b1-a675-dff748ac41be" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-4ee5a68a-8410-40b1-a675-dff748ac41be" acquired by "delete_volume" :: waited 0.046s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:07 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c" returned: 0 in 0.371s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.063s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182675139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6d441d-d587-4a1a-9445-be2fce3f317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:05Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Creating volume 3b6d441d-d587-4a1a-9445-be2fce3f317f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:07 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:07 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[888cac57-d2c4-42c9-8cbb-49610f9eac3a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5134925f-da1c-4db2-8485-be28110812bb_sey57hs7" returned: 1 in 0.524s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5134925f-da1c-4db2-8485-be28110812bb_sey57hs7' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ddb449-1f56-449c-8b6a-13dab6188466]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0694959f-0a04-481f-beea-d247fad4c489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28536d7b-f5e2-4a15-9960-de9b36534193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:07 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c (ed95ae0a-b52e-45ea-b14d-454507e72d0c): created successfully Nov 02 10:20:07 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f 1073741824 Nov 02 10:20:07 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28536d7b-f5e2-4a15-9960-de9b36534193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (89c21f3f-65c8-4466-99be-7e5ac4b59060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:07 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.412s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:07 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Deleted volume successfully. Nov 02 10:20:07 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-24f0142b-cd96-46b1-a3e4-72b241f3016c tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created volume successfully. Nov 02 10:20:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a69e18b8-8d8a-4ee2-a498-90124caff3ff tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-ce80c394-a931-4ea3-b3f9-21335c29fe1f-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:08 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be Nov 02 10:20:08 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD Nov 02 10:20:08 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be" returned: 0 in 0.502s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be Nov 02 10:20:08 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f 1073741824" returned: 0 in 0.615s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD Nov 02 10:20:08 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f Nov 02 10:20:08 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4ee5a68a-8410-40b1-a675-dff748ac41be" returned: 0 in 0.279s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-4ee5a68a-8410-40b1-a675-dff748ac41be" released by "delete_volume" :: held 0.872s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:08 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] 5134925f-da1c-4db2-8485-be28110812bb was raw, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc Nov 02 10:20:08 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created reservations ['6c6ef318-9532-4348-b0a4-e2023814c79c', '0037d554-a0e4-42af-87ed-c72fce1c0c9d', '0b7b186f-7f59-4e24-9e2e-7d8d10c30bf7', 'b7024e3b-5704-4511-bc8d-84a7e40a80ed'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:08 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f" returned: 0 in 0.291s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.526s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-218073610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88071f55-b96b-4360-b130-69d30f13948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:05Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Creating volume 88071f55-b96b-4360-b130-69d30f13948a {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:08 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44315ae-87b2-4b2c-9afe-01c665d6c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6d441d-d587-4a1a-9445-be2fce3f317f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c85c6ac-aa58-49a9-b607-432d38522aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:08 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a 1073741824 Nov 02 10:20:08 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume volume-3b6d441d-d587-4a1a-9445-be2fce3f317f (3b6d441d-d587-4a1a-9445-be2fce3f317f): created successfully Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c85c6ac-aa58-49a9-b607-432d38522aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (2f3c6827-e472-4e93-90bd-f51ea2cb16ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:08 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9c4676a1-87d0-4980-a943-e13e02a9d060 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created volume successfully. Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:08 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:09 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.266s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Deleted volume successfully. Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c3702ca1-f570-4831-91b6-62c7bfa3bdd8 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-4ee5a68a-8410-40b1-a675-dff748ac41be-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:09 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc" returned: 0 in 0.610s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5134925f-da1c-4db2-8485-be28110812bb_t9tn9z6cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:20:09 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:09 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a 1073741824" returned: 0 in 0.512s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:09 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc 1G Nov 02 10:20:09 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:09 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a Nov 02 10:20:09 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:09 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc 1G" returned: 0 in 0.306s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Downloaded image 5134925f-da1c-4db2-8485-be28110812bb ((None, [{'url': 'file:///opt/stack/data/glance/images/5134925f-da1c-4db2-8485-be28110812bb', 'metadata': {}}])) to volume fffbf5f9-9150-4b7c-81dd-f4c60dc725cc successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Temporary image 5134925f-da1c-4db2-8485-be28110812bb for user 9974aa82a2eb4f0bb0abe273fd2b4691 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:20:09 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Marking volume fffbf5f9-9150-4b7c-81dd-f4c60dc725cc as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955461971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280c28bf-3424-46ae-9a35-4aea028980d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:05Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Creating volume 280c28bf-3424-46ae-9a35-4aea028980d8 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:09 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Copying metadata from image 5134925f-da1c-4db2-8485-be28110812bb to fffbf5f9-9150-4b7c-81dd-f4c60dc725cc. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Creating volume glance metadata for volume fffbf5f9-9150-4b7c-81dd-f4c60dc725cc backed by image 5134925f-da1c-4db2-8485-be28110812bb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5134925f-da1c-4db2-8485-be28110812bb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '202974f436a3fb78a9a78b9024fb4d2d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:20:09 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 1073741824 Nov 02 10:20:09 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1f9f1e-1467-48ea-a80f-625d73e6ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88071f55-b96b-4360-b130-69d30f13948a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d3ce74-cb92-42d2-bb52-483da1bc1e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume volume-88071f55-b96b-4360-b130-69d30f13948a (88071f55-b96b-4360-b130-69d30f13948a): created successfully Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d3ce74-cb92-42d2-bb52-483da1bc1e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (5a8d623b-0acc-4e81-8ce5-142ec576b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ecf9963e-4abf-4929-868e-cbd7e475464a tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created volume successfully. Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e825e9-e4cc-42f2-b2d3-a8cbd38cdb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc', 'volume_size': 1, 'image_id': '5134925f-da1c-4db2-8485-be28110812bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5134925f-da1c-4db2-8485-be28110812bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '202974f436a3fb78a9a78b9024fb4d2d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '115ada5f3eb849029cf2c8650a1f70b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b39f19d1521722c7d2af1b8aaae2a22c7f7f5672020a70121fdcbdfe66522eb48b7ef4133e0656f540d79ce46b8ea54a12d61612da10446c9922cf0ed39e57c', 'id': '5134925f-da1c-4db2-8485-be28110812bb', 'created_at': datetime.datetime(2026, 11, 2, 9, 19, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5134925f-da1c-4db2-8485-be28110812bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223e551a-3033-423a-bbe7-89f90a9d0178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:09 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Volume volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc (fffbf5f9-9150-4b7c-81dd-f4c60dc725cc): created successfully Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223e551a-3033-423a-bbe7-89f90a9d0178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Flow 'volume_create_manager' (a1ae1218-22c3-4ded-a5b9-c2b8d00c390b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f3998981-f8cf-47ab-b2b3-ceedb7341b43 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Created volume successfully. Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-ac615934-235d-49e0-bad6-807eb8dc067c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-ac615934-235d-49e0-bad6-807eb8dc067c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-quobyte-ac615934-235d-49e0-bad6-807eb8dc067c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-ac615934-235d-49e0-bad6-807eb8dc067c" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4fb26d-dec2-4ef1-89d9-c184b213be66]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Acquiring lock "cinder-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "cinder-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Acquiring lock "cinder-quobyte-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "cinder-quobyte-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:10 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c Nov 02 10:20:10 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18bb77b-98c1-4567-b745-e234522017f7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 1073741824" returned: 0 in 0.582s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 Nov 02 10:20:10 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc Nov 02 10:20:10 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c" returned: 0 in 0.417s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c Nov 02 10:20:10 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8" returned: 0 in 0.270s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.521s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135463014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463495f4-0ec2-4b6d-a23a-0d905c86606e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300086e17c6448d58fd469caf8dd5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:06Z,use_quota=True,user_id='133dde1bf23c46c38cbd8cfc92d65883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Creating volume 463495f4-0ec2-4b6d-a23a-0d905c86606e {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:10 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e 1073741824 Nov 02 10:20:10 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ffafa6-d0f4-4f51-be0e-a37e9171893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280c28bf-3424-46ae-9a35-4aea028980d8', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3aabee-a7a4-4709-976d-822603b52c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc" returned: 0 in 0.419s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume volume-280c28bf-3424-46ae-9a35-4aea028980d8 (280c28bf-3424-46ae-9a35-4aea028980d8): created successfully Nov 02 10:20:10 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc Nov 02 10:20:10 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3aabee-a7a4-4709-976d-822603b52c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (de268b48-05df-4a65-b28c-9c198041fc13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:10 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8541e71e-8022-4725-b677-2cebbca92a9e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created volume successfully. Nov 02 10:20:10 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ac615934-235d-49e0-bad6-807eb8dc067c" returned: 0 in 0.272s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-ac615934-235d-49e0-bad6-807eb8dc067c" released by "delete_volume" :: held 0.742s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created reservations ['392474b0-9165-447f-bafc-068464279ba8', 'f354ed26-fe0d-4b0e-838a-3c209894cb6b', '53794064-9b26-4901-bac3-6e2f3f56a7f2', 'c8c7d739-cf4f-4ca7-b974-afff42afa9a3'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:10 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc" returned: 0 in 0.297s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:10 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "cinder-quobyte-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc" released by "delete_volume" :: held 0.784s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:10 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Created reservations ['266d926e-7a6e-4190-80c6-eef25d928549', 'f82a6ed2-0a06-44be-9340-7b522ca99799', '190738d8-cb98-4185-bf9b-00b0c05ae7eb', '4defb46f-099e-4eff-88e0-74cd20694189'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e 1073741824" returned: 0 in 0.553s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-81b32695-f2d0-4f77-9770-ba8e461bd851-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:11 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:11 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-81b32695-f2d0-4f77-9770-ba8e461bd851-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.352s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:11 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e Nov 02 10:20:11 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Deleted volume successfully. Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-quobyte-81b32695-f2d0-4f77-9770-ba8e461bd851" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9e5b32cc-cccb-4d90-9955-f3942b8c48a6 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-ac615934-235d-49e0-bad6-807eb8dc067c-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-81b32695-f2d0-4f77-9770-ba8e461bd851" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce62480-b13d-41cb-8565-41e3dbd6749a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 Nov 02 10:20:11 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:11 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.461s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Deleted volume successfully. Nov 02 10:20:11 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e" returned: 0 in 0.406s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-291a3ee6-c06e-4ad5-88f1-be482d75db48 tempest-VolumeAndVolumeTypeFromImageTest-1003067725 None] Lock "cinder-fffbf5f9-9150-4b7c-81dd-f4c60dc725cc-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.823s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26519813-0f80-48a8-b278-c748a2906999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463495f4-0ec2-4b6d-a23a-0d905c86606e', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa78464-dbab-457a-8151-4886e68490cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 59d37324-ee11-45bc-b9f6-813e2597380a of volume a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:11 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Volume volume-463495f4-0ec2-4b6d-a23a-0d905c86606e (463495f4-0ec2-4b6d-a23a-0d905c86606e): created successfully Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa78464-dbab-457a-8151-4886e68490cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Flow 'volume_create_manager' (c72b042a-881e-4962-a2fd-733af993d7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fed760c-d926-4e96-96e8-00b6f8cf4cf2]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0931d65e-fbef-413e-b238-f2ea392022f0 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created volume successfully. Nov 02 10:20:11 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851" returned: 0 in 0.439s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 Nov 02 10:20:11 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:11 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851 Nov 02 10:20:11 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:12 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-81b32695-f2d0-4f77-9770-ba8e461bd851" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:12 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" returned: 0 in 0.395s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-81b32695-f2d0-4f77-9770-ba8e461bd851" released by "delete_volume" :: held 0.772s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:12 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a 1G Nov 02 10:20:12 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created reservations ['b876083e-b24c-4193-8fc5-87a7c9d48c38', 'f0dea5a9-5d76-4124-a1ed-53585739f12c', '489ad560-62e1-4d1a-8f02-3905dbe7751b', '8d133618-df02-4c0f-9c58-085fe700b401'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:12 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:12 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-3c9634af-5fcb-452c-9672-e12f5e5ba041-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-3c9634af-5fcb-452c-9672-e12f5e5ba041-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "cinder-quobyte-3c9634af-5fcb-452c-9672-e12f5e5ba041" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-3c9634af-5fcb-452c-9672-e12f5e5ba041" acquired by "delete_volume" :: waited 0.046s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bdcb30-e545-4584-a918-b9a15f08b51a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:12 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.411s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Deleted volume successfully. Nov 02 10:20:12 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-463495f4-0ec2-4b6d-a23a-0d905c86606e-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a 1G" returned: 0 in 0.630s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-463495f4-0ec2-4b6d-a23a-0d905c86606e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-06473342-e6fc-4dc7-8d34-4c9968c885a9 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-81b32695-f2d0-4f77-9770-ba8e461bd851-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:12 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a Nov 02 10:20:12 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-463495f4-0ec2-4b6d-a23a-0d905c86606e" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-463495f4-0ec2-4b6d-a23a-0d905c86606e" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:12 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 Nov 02 10:20:12 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e42b1f-754e-484b-9ca3-5553a8b359ac]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e Nov 02 10:20:13 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:13 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a" returned: 0 in 0.495s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:13 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a is being set with open permissions: ugo+rw Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a Nov 02 10:20:13 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:13 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041" returned: 0 in 0.636s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041 Nov 02 10:20:13 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:13 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e" returned: 0 in 0.547s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e Nov 02 10:20:13 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:13 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a" returned: 0 in 0.328s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3c9634af-5fcb-452c-9672-e12f5e5ba041" returned: 0 in 0.364s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:13 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.info Nov 02 10:20:13 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-quobyte-3c9634af-5fcb-452c-9672-e12f5e5ba041" released by "delete_volume" :: held 1.085s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Created reservations ['beaaac7f-d43c-41b0-b899-8499842842ef', 'd61d17e1-5bf3-42dc-a228-44012aca90b2', '4619c128-b86f-453b-af03-aff7dbbf0ae4', '5ad7736f-bf8a-41db-984d-7449963abcd0'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:13 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-463495f4-0ec2-4b6d-a23a-0d905c86606e" returned: 0 in 0.326s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-463495f4-0ec2-4b6d-a23a-0d905c86606e" released by "delete_volume" :: held 0.952s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:13 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created reservations ['06c19dec-c50c-441d-8d87-f69a137b2297', '61dc09ba-ff27-4c8d-b56e-e8559253a51a', 'ee5bdb07-1d29-4f85-9822-68bad32aa28f', '9c42eb40-d911-4cdb-893d-9623880db72c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:13 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.info" returned: 0 in 0.360s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:13 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.info is being set with open permissions: ugo+rw Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.info Nov 02 10:20:13 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:13 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:13 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:14 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.325s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Deleted volume successfully. Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-44778f5f-8c1b-4d84-bb51-bc34475a6409 tempest-CreateVolumesFromSourceVolumeTest-1960106271 None] Lock "cinder-3c9634af-5fcb-452c-9672-e12f5e5ba041-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:14 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.info" returned: 0 in 0.346s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:14 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.325s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Deleted volume successfully. Nov 02 10:20:14 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1b033dae-da3f-41da-a5f7-8e0e8ead992e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-463495f4-0ec2-4b6d-a23a-0d905c86606e-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:14 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-35084a4a-b874-4fd4-95d7-c3cad67de8b9 tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-280c28bf-3424-46ae-9a35-4aea028980d8-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-280c28bf-3424-46ae-9a35-4aea028980d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-280c28bf-3424-46ae-9a35-4aea028980d8" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-280c28bf-3424-46ae-9a35-4aea028980d8" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53894c8-fc90-4969-a4d2-3387f294048c]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-59d37324-ee11-45bc-b9f6-813e2597380a-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-59d37324-ee11-45bc-b9f6-813e2597380a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-59d37324-ee11-45bc-b9f6-813e2597380a" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-59d37324-ee11-45bc-b9f6-813e2597380a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 59d37324-ee11-45bc-b9f6-813e2597380a of volume a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfccfa96-02c7-4adb-8475-caecd0d345c0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:15 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 Nov 02 10:20:15 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:15 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a Nov 02 10:20:15 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:15 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8" returned: 0 in 0.535s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:15 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8 Nov 02 10:20:15 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:15 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a" returned: 0 in 0.449s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b404a9-3530-40b5-99a0-ce17c12a0bf4]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:15 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 Nov 02 10:20:15 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:16 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-280c28bf-3424-46ae-9a35-4aea028980d8" returned: 0 in 0.323s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-280c28bf-3424-46ae-9a35-4aea028980d8" released by "delete_volume" :: held 0.923s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created reservations ['dc3ca06e-3d08-4453-89c5-7b38e9cfd81f', 'b5de7287-add5-43f4-ae0c-a5092f0684af', '0f3341c9-d179-4d6c-a8fd-a27ad91fca37', '523f8c94-ca50-49cb-bf15-013cef7de909'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:16 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:16 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:16 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-88071f55-b96b-4360-b130-69d30f13948a-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" returned: 0 in 0.585s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-88071f55-b96b-4360-b130-69d30f13948a-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:16 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a Nov 02 10:20:16 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-88071f55-b96b-4360-b130-69d30f13948a" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-88071f55-b96b-4360-b130-69d30f13948a" acquired by "delete_volume" :: waited 0.030s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[52056ce9-7349-4598-b684-16cf840ca681]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:16 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.384s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:16 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Deleted volume successfully. Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4e4158ef-f7a4-48d4-82c7-a04f759e6a53 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-280c28bf-3424-46ae-9a35-4aea028980d8-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:16 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a Nov 02 10:20:16 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:16 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a" returned: 0 in 0.512s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:16 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a Nov 02 10:20:16 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:17 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a" returned: 0 in 0.533s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:17 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a Nov 02 10:20:17 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:17 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7.59d37324-ee11-45bc-b9f6-813e2597380a" returned: 0 in 0.333s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (893d1272-5611-40e0-849f-acb6a705db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99080552-ef82-42b1-b626-d5a24d2a2dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99080552-ef82-42b1-b626-d5a24d2a2dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2072677204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732f0027-c440-40c6-bd32-4f33c1248384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:17Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cae87f9-2625-477e-b88c-dc5064a9940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cae87f9-2625-477e-b88c-dc5064a9940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88d6515-abff-4a0b-9e77-f514f52c7e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88d6515-abff-4a0b-9e77-f514f52c7e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732f0027-c440-40c6-bd32-4f33c1248384', 'volume_name': 'volume-732f0027-c440-40c6-bd32-4f33c1248384', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4b1243-50f7-418b-9226-964504ce504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4b1243-50f7-418b-9226-964504ce504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c9104c-6cb9-4b48-b7df-b667100510ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Volume 732f0027-c440-40c6-bd32-4f33c1248384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732f0027-c440-40c6-bd32-4f33c1248384', 'volume_size': 1} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2072677204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732f0027-c440-40c6-bd32-4f33c1248384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:17Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Creating volume 732f0027-c440-40c6-bd32-4f33c1248384 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:17 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:17 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-59d37324-ee11-45bc-b9f6-813e2597380a" released by "_delete_snapshot" :: held 2.267s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-88071f55-b96b-4360-b130-69d30f13948a" returned: 0 in 0.416s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:17 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 1073741824 Nov 02 10:20:17 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" released by "delete_snapshot" :: held 2.325s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-88071f55-b96b-4360-b130-69d30f13948a" released by "delete_volume" :: held 1.068s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created reservations ['f29cf1d7-6205-490f-9a73-5da886580558', '9d878a9e-9933-480d-9519-de60091475cb', '6ef06026-4073-4c83-8279-39392dec9093', 'e05e75aa-009f-44f8-9b55-713396b7ae60'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Created reservations ['eec2ae3e-4b49-441a-9284-cec4100f5d0b', '773cd997-bddb-431b-a9b1-5fafea6246cb', '31c906bc-7b98-4f05-9b5d-c86f6222e206', '88106f8b-ce46-42fa-80dc-4ef3bdb55868'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (c8e629bb-472a-4fcc-aeb5-b2992d0c136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10c9e3b-8fda-45e3-92d1-d7005ccfd25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10c9e3b-8fda-45e3-92d1-d7005ccfd25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2044220359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92bfd5e-693e-4a2b-a6b7-82a4de36f573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:18Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531e35a4-14a3-4753-88b9-e3ddcaf92889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531e35a4-14a3-4753-88b9-e3ddcaf92889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc5258-f1f7-468e-8d5d-3db0f64fe3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc5258-f1f7-468e-8d5d-3db0f64fe3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92bfd5e-693e-4a2b-a6b7-82a4de36f573', 'volume_name': 'volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b87ff13-2a4c-41b5-9ed8-d04248c8b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b87ff13-2a4c-41b5-9ed8-d04248c8b86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d40ba56-91df-4e99-9e24-e600bf6d4d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:17 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Volume c92bfd5e-693e-4a2b-a6b7-82a4de36f573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573', 'volume_size': 1} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:17 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6d485803-69ab-470a-a53f-d7ffd1d192d1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-59d37324-ee11-45bc-b9f6-813e2597380a-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:17 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:17 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:18 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 1073741824" returned: 0 in 0.737s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:18 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 Nov 02 10:20:18 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:18 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.447s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:18 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Deleted volume successfully. Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-56c10ff8-2b79-42b5-946f-1361c968fabd tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-88071f55-b96b-4360-b130-69d30f13948a-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (909ec27b-9b67-4863-80be-0a9f31a1f82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44462a3-771e-4ce4-8b52-4627e2837845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44462a3-771e-4ce4-8b52-4627e2837845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413300318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cb7bdc-b749-492a-8b6d-692b720bafce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:18Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a46b00-3bf8-4a8f-95cc-1441df90cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a46b00-3bf8-4a8f-95cc-1441df90cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de43c73-0d5d-4549-9680-7ef098160972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de43c73-0d5d-4549-9680-7ef098160972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cb7bdc-b749-492a-8b6d-692b720bafce', 'volume_name': 'volume-61cb7bdc-b749-492a-8b6d-692b720bafce', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57aebd9-acfa-4db6-95aa-a73ee5b986a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57aebd9-acfa-4db6-95aa-a73ee5b986a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1634692-9803-4354-87c0-c4b164cc83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:18 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Volume 61cb7bdc-b749-492a-8b6d-692b720bafce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cb7bdc-b749-492a-8b6d-692b720bafce', 'volume_size': 1} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:18 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-3b6d441d-d587-4a1a-9445-be2fce3f317f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384" returned: 0 in 0.493s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2044220359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92bfd5e-693e-4a2b-a6b7-82a4de36f573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:18Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Creating volume c92bfd5e-693e-4a2b-a6b7-82a4de36f573 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:18 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" acquired by "delete_volume" :: waited 0.108s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:18 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 1073741824 Nov 02 10:20:18 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-3b6d441d-d587-4a1a-9445-be2fce3f317f-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c9104c-6cb9-4b48-b7df-b667100510ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732f0027-c440-40c6-bd32-4f33c1248384', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6923261a-9c4e-4ac3-8dbd-e4df9f1939a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[022c4041-f7e2-4e7b-87d5-d24eafedc9b8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:18 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Volume volume-732f0027-c440-40c6-bd32-4f33c1248384 (732f0027-c440-40c6-bd32-4f33c1248384): created successfully Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6923261a-9c4e-4ac3-8dbd-e4df9f1939a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (893d1272-5611-40e0-849f-acb6a705db5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:18 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (35472bfa-a5c0-4c17-b980-ac732ed9ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44f867d-2b88-4d53-b038-c8790519bccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-989d025c-37b7-4b89-8526-3ea933cce72b tempest-CreateVolumesFromImageTest-751113892 None] Created volume successfully. Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-3b6d441d-d587-4a1a-9445-be2fce3f317f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44f867d-2b88-4d53-b038-c8790519bccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-548362659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46c08f0-bf55-4985-bb9f-5edf8aee459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:19Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836b3972-0192-4f8c-bfd7-adbfaae38382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836b3972-0192-4f8c-bfd7-adbfaae38382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd642bd-f5d7-497e-8bb0-6f388eed248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd642bd-f5d7-497e-8bb0-6f388eed248d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46c08f0-bf55-4985-bb9f-5edf8aee459b', 'volume_name': 'volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e495cc-ea6c-4118-b3e2-90e63ff06fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e495cc-ea6c-4118-b3e2-90e63ff06fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d819c9-ae90-4cde-bc04-5f1ebe9fcd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Volume b46c08f0-bf55-4985-bb9f-5edf8aee459b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b', 'volume_size': 1} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-3b6d441d-d587-4a1a-9445-be2fce3f317f" acquired by "delete_volume" :: waited 0.071s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[42296791-2a8b-439a-8d86-8598dc8dbe8f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:19 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 Nov 02 10:20:19 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:19 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f Nov 02 10:20:19 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:19 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 1073741824" returned: 0 in 0.673s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:19 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" returned: 0 in 0.628s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:19 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 Nov 02 10:20:19 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:19 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7 Nov 02 10:20:19 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (73b6d6dd-c75a-4dd4-879b-e0616475a589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d86c98-211a-44df-8ee8-74e83aff277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d86c98-211a-44df-8ee8-74e83aff277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2143298958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350d2ac3-818a-4841-b074-1f688d985291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:19Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c820ef67-ee52-4c69-8222-23cd3be1f1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c820ef67-ee52-4c69-8222-23cd3be1f1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437340ce-4570-41f6-a35f-729c979cb1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437340ce-4570-41f6-a35f-729c979cb1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350d2ac3-818a-4841-b074-1f688d985291', 'volume_name': 'volume-350d2ac3-818a-4841-b074-1f688d985291', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e6c175-058f-42d7-9b87-ab39db6ce5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e6c175-058f-42d7-9b87-ab39db6ce5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab10e11b-2e7a-4422-a061-3db7e107c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Volume 350d2ac3-818a-4841-b074-1f688d985291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350d2ac3-818a-4841-b074-1f688d985291', 'volume_size': 1} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:19 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f" returned: 0 in 0.603s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ccad5b7d-dd16-46ab-b5e0-68696669f12d tempest-ProjectAdminTests-750258817 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87005) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:20:19 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f Nov 02 10:20:19 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:19 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" returned: 0 in 0.305s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:19 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7" released by "delete_volume" :: held 1.059s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413300318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cb7bdc-b749-492a-8b6d-692b720bafce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:18Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Creating volume 61cb7bdc-b749-492a-8b6d-692b720bafce {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:19 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d40ba56-91df-4e99-9e24-e600bf6d4d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce 1073741824 Nov 02 10:20:19 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d240a8-dd52-4a71-aa82-1c7e606c8dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Volume volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 (c92bfd5e-693e-4a2b-a6b7-82a4de36f573): created successfully Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d240a8-dd52-4a71-aa82-1c7e606c8dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (c8e629bb-472a-4fcc-aeb5-b2992d0c136b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c118001b-df40-4dc3-9d7c-4f6cf0844b90 tempest-CreateVolumesFromImageTest-751113892 None] Created volume successfully. Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Created reservations ['5695715d-9d11-48e0-96a0-d7005fdb9a40', 'c5d286ef-bbd8-47a6-9937-609c2de031ab', 'a9c55884-12bb-4408-a162-56f4b5b43398', '41567e33-8700-4be3-8e27-51be189fb24f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:20 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3b6d441d-d587-4a1a-9445-be2fce3f317f" returned: 0 in 0.314s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-3b6d441d-d587-4a1a-9445-be2fce3f317f" released by "delete_volume" :: held 0.988s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created reservations ['748d6265-bf21-4744-8c08-0bc13682bc8e', '6b5f7c3d-f207-4187-95ba-1fd3aa13c482', 'ea5eefba-c506-4c15-b70f-48eb2587a6b4', 'b17225e4-29a4-483c-ab03-0626d0bcc3ee'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:20 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:20 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:20 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:20 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:20 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce 1073741824" returned: 0 in 0.552s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:20 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.319s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-67e10617-3977-4ed7-b48f-c32d4fa964d3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-a41f319c-c4b6-4d3b-819f-6c5359ce3ca7-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:20 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce Nov 02 10:20:20 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:20 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.323s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Deleted volume successfully. Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-88bd88d8-ade4-4ca6-8e4a-9b27c37d9c83 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-3b6d441d-d587-4a1a-9445-be2fce3f317f-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:20 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-548362659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46c08f0-bf55-4985-bb9f-5edf8aee459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:19Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Creating volume b46c08f0-bf55-4985-bb9f-5edf8aee459b {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:20 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1634692-9803-4354-87c0-c4b164cc83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cb7bdc-b749-492a-8b6d-692b720bafce', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4baa7239-1a29-4030-903f-5fbd178ef53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:20 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b 1073741824 Nov 02 10:20:20 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:20 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Volume volume-61cb7bdc-b749-492a-8b6d-692b720bafce (61cb7bdc-b749-492a-8b6d-692b720bafce): created successfully Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4baa7239-1a29-4030-903f-5fbd178ef53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (909ec27b-9b67-4863-80be-0a9f31a1f82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6db24fa9-ec65-4342-9135-37696b82e4cd tempest-CreateVolumesFromImageTest-751113892 None] Created volume successfully. Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-ed95ae0a-b52e-45ea-b14d-454507e72d0c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-ed95ae0a-b52e-45ea-b14d-454507e72d0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-ed95ae0a-b52e-45ea-b14d-454507e72d0c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-ed95ae0a-b52e-45ea-b14d-454507e72d0c" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da2e51-47ab-4800-978e-ba3541b22655]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (3922a41f-de8b-455d-b5f6-883402c09ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:21 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c Nov 02 10:20:21 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a53832-edd4-415c-bf42-dfe0abbe5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a53832-edd4-415c-bf42-dfe0abbe5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51740266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a83f7fd-2687-4e63-84ba-c6c54e01ebba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:21Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed407043-3013-431f-bd70-a23431295aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed407043-3013-431f-bd70-a23431295aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fa7825-1f07-47eb-94cc-1d8f2061baec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:21 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fa7825-1f07-47eb-94cc-1d8f2061baec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a83f7fd-2687-4e63-84ba-c6c54e01ebba', 'volume_name': 'volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ade9b0-d0be-4184-bd68-60aeec28d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ade9b0-d0be-4184-bd68-60aeec28d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74c3478-22c7-47a8-9e91-46dd2e6c4613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:21 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Volume 8a83f7fd-2687-4e63-84ba-c6c54e01ebba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba', 'volume_size': 1} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b 1073741824" returned: 0 in 0.672s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:21 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b Nov 02 10:20:21 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:21 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c" returned: 0 in 0.481s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:21 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c Nov 02 10:20:21 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:21 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b" returned: 0 in 0.301s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.135s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2143298958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350d2ac3-818a-4841-b074-1f688d985291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecec564269845b39364529acf6e7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:19Z,use_quota=True,user_id='3aebf15e804c4710a3a457630c24e449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Creating volume 350d2ac3-818a-4841-b074-1f688d985291 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:21 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d819c9-ae90-4cde-bc04-5f1ebe9fcd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:21 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 1073741824 Nov 02 10:20:21 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db9f209-3cef-4020-9b4a-fb9ba46aea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:21 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Volume volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b (b46c08f0-bf55-4985-bb9f-5edf8aee459b): created successfully Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db9f209-3cef-4020-9b4a-fb9ba46aea67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:21 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (35472bfa-a5c0-4c17-b980-ac732ed9ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:21 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8450cb9a-e742-4943-b640-89f2ee9b5b38 tempest-CreateVolumesFromImageTest-751113892 None] Created volume successfully. Nov 02 10:20:22 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ed95ae0a-b52e-45ea-b14d-454507e72d0c" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-ed95ae0a-b52e-45ea-b14d-454507e72d0c" released by "delete_volume" :: held 0.814s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created reservations ['994fa2fe-5aa7-4719-a763-600f947458a6', '870a5ef4-e31b-4187-b41e-a0733eb9224e', 'a3ccbee9-3af9-43c8-8d67-f1dbf0fa67af', '04ed724a-9500-4e74-bda2-fb6087e07f73'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:22 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:22 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-aef4d110-d601-4203-afc0-b42eacdd7556-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-aef4d110-d601-4203-afc0-b42eacdd7556-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-aef4d110-d601-4203-afc0-b42eacdd7556" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-aef4d110-d601-4203-afc0-b42eacdd7556" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Deleting offline snapshot aef4d110-d601-4203-afc0-b42eacdd7556 of volume aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] snapshot_file for this snap is: volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:20:22 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 1073741824" returned: 0 in 0.595s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cfad00-ce5a-4c37-875d-e96471223bd2]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:22 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Deleted volume successfully. Nov 02 10:20:22 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 Nov 02 10:20:22 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a7cc6aa7-ccf3-4f82-876b-1591a9cbfcd6 tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-ed95ae0a-b52e-45ea-b14d-454507e72d0c-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:22 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 Nov 02 10:20:22 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:22 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51740266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a83f7fd-2687-4e63-84ba-c6c54e01ebba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:21Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Creating volume 8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:22 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:22 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba 1073741824 Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab10e11b-2e7a-4422-a061-3db7e107c228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350d2ac3-818a-4841-b074-1f688d985291', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:22 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031dd0a2-fa80-4049-90cb-dc44a2a47661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Volume volume-350d2ac3-818a-4841-b074-1f688d985291 (350d2ac3-818a-4841-b074-1f688d985291): created successfully Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031dd0a2-fa80-4049-90cb-dc44a2a47661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:22 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Flow 'volume_create_manager' (73b6d6dd-c75a-4dd4-879b-e0616475a589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556" returned: 0 in 0.431s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ceaa5baf-fa80-4aa4-a97e-9bd2af562624 tempest-CreateVolumesFromImageTest-751113892 None] Created volume successfully. Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ffa3d0-9fdf-4459-b181-5ed79e82cbb0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-350d2ac3-818a-4841-b074-1f688d985291-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-350d2ac3-818a-4841-b074-1f688d985291-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:23 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b Nov 02 10:20:23 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-quobyte-350d2ac3-818a-4841-b074-1f688d985291" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-350d2ac3-818a-4841-b074-1f688d985291" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df485dd-a1ba-4e67-b04f-23860bbf73db]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:23 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 Nov 02 10:20:23 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:23 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba 1073741824" returned: 0 in 0.636s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:23 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" returned: 0 in 0.516s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:23 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 Nov 02 10:20:23 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:23 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba Nov 02 10:20:23 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:23 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291" returned: 0 in 0.489s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:23 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291 Nov 02 10:20:23 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:23 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" returned: 0 in 0.301s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74c3478-22c7-47a8-9e91-46dd2e6c4613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6685357b-8b93-4912-900a-dbc491513e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:23 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Volume volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba (8a83f7fd-2687-4e63-84ba-c6c54e01ebba): created successfully Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6685357b-8b93-4912-900a-dbc491513e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:23 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (3922a41f-de8b-455d-b5f6-883402c09ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556" returned: 0 in 0.427s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:23 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-517b4c15-1b63-400d-882d-31ee9f56f97e tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:20:23 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556 Nov 02 10:20:23 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:23 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-350d2ac3-818a-4841-b074-1f688d985291" returned: 0 in 0.310s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:23 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-350d2ac3-818a-4841-b074-1f688d985291" released by "delete_volume" :: held 0.853s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Created reservations ['aea631b1-e402-4c3d-b90e-a3696eef89a8', '8656e9ec-2fc5-43e1-b13b-cf2b55e89ad5', '1ccd6e80-2f1d-4323-8a85-0a3cf0ceefe2', 'a228d948-41bd-48d7-951e-6601355f95ae'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:24 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:24 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:24 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b.aef4d110-d601-4203-afc0-b42eacdd7556" returned: 0 in 0.310s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-aef4d110-d601-4203-afc0-b42eacdd7556" released by "_delete_snapshot" :: held 1.874s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-b46c08f0-bf55-4985-bb9f-5edf8aee459b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" released by "delete_snapshot" :: held 1.917s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-b46c08f0-bf55-4985-bb9f-5edf8aee459b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-quobyte-b46c08f0-bf55-4985-bb9f-5edf8aee459b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-b46c08f0-bf55-4985-bb9f-5edf8aee459b" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created reservations ['f0e3df75-abb5-4353-871f-dd660a9f1a94', '21d00670-d684-4cca-968f-9af29365e382', '909d2941-492d-4c9d-80b9-91c17ce13dfc', '26b69f27-850e-4306-84de-026425219a6d'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e745a6-08d9-445f-8be4-f054b536e145]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:24 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.386s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Deleted volume successfully. Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0319bcc3-cf9f-4fa8-bc42-30a3ffc1071a tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-350d2ac3-818a-4841-b074-1f688d985291-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Delete snapshot completed successfully. Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-7542cd80-b8c7-4388-abe0-10dc239b4e7b tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-aef4d110-d601-4203-afc0-b42eacdd7556-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:24 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b Nov 02 10:20:24 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (b4cae1e2-2215-4f8e-9633-c6c1578fd193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1dfaa8-9ad2-41fe-8aa3-74913c7b5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1dfaa8-9ad2-41fe-8aa3-74913c7b5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659981536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a771f5-1007-497d-943b-0743428cd61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:25Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00205c94-7d3f-47a7-9ec2-200f948ae4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00205c94-7d3f-47a7-9ec2-200f948ae4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4583f75a-523a-4d51-9f40-d9b1a6ce1a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4583f75a-523a-4d51-9f40-d9b1a6ce1a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a771f5-1007-497d-943b-0743428cd61f', 'volume_name': 'volume-f7a771f5-1007-497d-943b-0743428cd61f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfd25b6-6a71-49da-90bb-6890ef7f75c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfd25b6-6a71-49da-90bb-6890ef7f75c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ed1f8-0395-4433-9ae3-354eafbf1374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Volume f7a771f5-1007-497d-943b-0743428cd61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a771f5-1007-497d-943b-0743428cd61f', 'volume_size': 1} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659981536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a771f5-1007-497d-943b-0743428cd61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:25Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Creating volume f7a771f5-1007-497d-943b-0743428cd61f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:24 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:24 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f 1073741824 Nov 02 10:20:24 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:24 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b" returned: 0 in 0.463s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:24 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b Nov 02 10:20:24 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:25 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-b46c08f0-bf55-4985-bb9f-5edf8aee459b" returned: 0 in 0.259s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-b46c08f0-bf55-4985-bb9f-5edf8aee459b" released by "delete_volume" :: held 0.802s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Created reservations ['848fff38-23a5-42df-b707-611b42a5f98d', '901cfbc7-21d6-41be-9c37-50db8481ca79', '1323f8c1-b61e-4149-a255-2759ff6a7ea9', '3f36593f-73ff-426b-8f27-0ab502a93476'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:25 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f 1073741824" returned: 0 in 0.494s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:25 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:25 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:25 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f Nov 02 10:20:25 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-61cb7bdc-b749-492a-8b6d-692b720bafce-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-61cb7bdc-b749-492a-8b6d-692b720bafce-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-quobyte-61cb7bdc-b749-492a-8b6d-692b720bafce" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-61cb7bdc-b749-492a-8b6d-692b720bafce" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8828eb6b-0c07-477a-8283-5d23629ad583]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "cinder-quobyte-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:25 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.389s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Deleted volume successfully. Nov 02 10:20:25 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce Nov 02 10:20:25 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49dea72-3414-4568-aab4-b15dc75c4903]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:25 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f" returned: 0 in 0.417s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-1d013d8e-139e-4aeb-b723-8b81d004d98d tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-b46c08f0-bf55-4985-bb9f-5edf8aee459b-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.958s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot f7e2a273-afd9-4286-86cb-3ab989f36a94 of volume 8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ed1f8-0395-4433-9ae3-354eafbf1374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a771f5-1007-497d-943b-0743428cd61f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36019c9-83a5-4186-8f8c-6296b5a396f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[452a9f93-e0de-4b52-a5ba-817fd3171012]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:25 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Volume volume-f7a771f5-1007-497d-943b-0743428cd61f (f7a771f5-1007-497d-943b-0743428cd61f): created successfully Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36019c9-83a5-4186-8f8c-6296b5a396f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:25 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (b4cae1e2-2215-4f8e-9633-c6c1578fd193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:25 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b Nov 02 10:20:25 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-63d47f5f-ec22-45f3-83e6-eafdaeaa43e3 tempest-ProjectReaderTests-453018252 None] Created volume successfully. Nov 02 10:20:25 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba Nov 02 10:20:25 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce" returned: 0 in 0.443s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce Nov 02 10:20:26 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" returned: 0 in 0.389s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b Nov 02 10:20:26 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" returned: 0 in 0.403s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 1G Nov 02 10:20:26 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-61cb7bdc-b749-492a-8b6d-692b720bafce" returned: 0 in 0.272s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-61cb7bdc-b749-492a-8b6d-692b720bafce" released by "delete_volume" :: held 0.799s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Created reservations ['d520e99b-d912-4ef9-870e-2613f6d53251', '4b1e069f-001d-4ab4-a6c4-b87012fa50f2', 'ec1e8032-1201-401c-a05f-8b196733ad53', 'f8bac6db-7e86-420b-9d5c-5e85e3bd0c06'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:26 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" returned: 0 in 0.266s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-quobyte-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b" released by "delete_volume" :: held 0.756s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:26 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Created reservations ['5d418aaa-1f41-47b6-9304-7d17a5172709', 'af5fa827-2acc-4844-87c3-9e3f3e2177e4', '13517e12-c766-41ac-8775-6ee8cfb20de2', 'f13a1c8f-9b23-4f0b-8d14-404dd5d419fe'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-c92bfd5e-693e-4a2b-a6b7-82a4de36f573-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:26 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:26 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-c92bfd5e-693e-4a2b-a6b7-82a4de36f573-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:26 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-quobyte-c92bfd5e-693e-4a2b-a6b7-82a4de36f573" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 1G" returned: 0 in 0.572s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-c92bfd5e-693e-4a2b-a6b7-82a4de36f573" acquired by "delete_volume" :: waited 0.042s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:26 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 Nov 02 10:20:26 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.385s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:26 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Deleted volume successfully. Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a14817-9a77-497b-8001-172b4e8ff9d0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fee4ac34-14de-4e9a-9b7e-221fc25a0768 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-61cb7bdc-b749-492a-8b6d-692b720bafce-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:27 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 Nov 02 10:20:27 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:27 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-f7a771f5-1007-497d-943b-0743428cd61f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.464s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Deleted volume successfully. Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Lock "cinder-f7a771f5-1007-497d-943b-0743428cd61f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-284a5a5d-be91-42c1-9f23-37bc780b553e tempest-CreateVolumesFromSnapshotTest-2039475862 None] Lock "cinder-aaedeb21-4ed2-4f83-8cae-4bc7db69bc2b-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-quobyte-f7a771f5-1007-497d-943b-0743428cd61f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-f7a771f5-1007-497d-943b-0743428cd61f" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5088ec-d905-434b-b450-be8e793c1ff2]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:27 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94" returned: 0 in 0.518s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:27 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 is being set with open permissions: ugo+rw Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:27 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 Nov 02 10:20:27 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:27 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f Nov 02 10:20:27 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:27 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573" returned: 0 in 0.574s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:27 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573 Nov 02 10:20:27 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:27 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94" returned: 0 in 0.290s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:27 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.info Nov 02 10:20:27 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:27 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f" returned: 0 in 0.479s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:27 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f Nov 02 10:20:27 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:27 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-c92bfd5e-693e-4a2b-a6b7-82a4de36f573" returned: 0 in 0.306s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-c92bfd5e-693e-4a2b-a6b7-82a4de36f573" released by "delete_volume" :: held 0.982s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:27 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Created reservations ['641de980-6d94-4e56-a282-555bba0ace3e', '5233e7ea-2071-4dd1-bb37-d17d38f44def', '6b2691aa-7046-49fd-86ac-0a33ae87fafa', 'bb9c3be5-fda6-44a4-bf9f-9fa928176e5e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:28 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.info" returned: 0 in 0.400s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:28 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:28 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:28 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.info is being set with open permissions: ugo+rw Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:28 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f7a771f5-1007-497d-943b-0743428cd61f" returned: 0 in 0.369s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:28 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.info Nov 02 10:20:28 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-f7a771f5-1007-497d-943b-0743428cd61f" released by "delete_volume" :: held 0.902s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Created reservations ['d19555ca-67f4-4ed5-a31f-b3565f5b45f2', 'd448d267-8bb1-4565-9a3d-a84a0b8ceaa1', '042a154f-f9a5-45d1-a6fd-667fae6228eb', 'e7854927-6dcc-4fc1-ab60-548a61008759'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:28 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:28 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:28 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.333s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Deleted volume successfully. Nov 02 10:20:28 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.info" returned: 0 in 0.355s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-0a13b345-223f-492f-8ce3-9f84dbbc16f6 tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-c92bfd5e-693e-4a2b-a6b7-82a4de36f573-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-890060a5-917e-4267-8325-87dc3bdc84b8 tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:20:28 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.361s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Deleted volume successfully. Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3a7aee14-1f06-476f-9ec4-d4915674f8cb tempest-ProjectReaderTests-453018252 None] Lock "cinder-f7a771f5-1007-497d-943b-0743428cd61f-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (acbf547e-115d-4d1f-b29f-c65dce8f5007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd6bbb1-6d7e-47b5-91ab-6ad4543104f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-732f0027-c440-40c6-bd32-4f33c1248384-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd6bbb1-6d7e-47b5-91ab-6ad4543104f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399411745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4c349e-747a-4a52-be77-aebb516a6b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:29Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5203567-5a28-4a91-89e9-14eb6265ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5203567-5a28-4a91-89e9-14eb6265ca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccfce3b-9790-4ec8-9fc5-a5005277aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccfce3b-9790-4ec8-9fc5-a5005277aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4c349e-747a-4a52-be77-aebb516a6b7a', 'volume_name': 'volume-bb4c349e-747a-4a52-be77-aebb516a6b7a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d534306e-3af6-40c3-9084-1e5400839157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d534306e-3af6-40c3-9084-1e5400839157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50b01de-d6cc-4e18-9952-2c8127eff62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Volume bb4c349e-747a-4a52-be77-aebb516a6b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4c349e-747a-4a52-be77-aebb516a6b7a', 'volume_size': 1} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399411745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4c349e-747a-4a52-be77-aebb516a6b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:29Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Creating volume bb4c349e-747a-4a52-be77-aebb516a6b7a {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:29 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-f7e2a273-afd9-4286-86cb-3ab989f36a94-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:29 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a 1073741824 Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-732f0027-c440-40c6-bd32-4f33c1248384-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:29 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-f7e2a273-afd9-4286-86cb-3ab989f36a94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-f7e2a273-afd9-4286-86cb-3ab989f36a94" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "cinder-quobyte-732f0027-c440-40c6-bd32-4f33c1248384" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-f7e2a273-afd9-4286-86cb-3ab989f36a94" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot f7e2a273-afd9-4286-86cb-3ab989f36a94 of volume 8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-732f0027-c440-40c6-bd32-4f33c1248384" acquired by "delete_volume" :: waited 0.045s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9d9435-ebb7-4899-b121-186b1f7385ac]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1fc020-f533-4f48-9847-b15e73fa4511]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:29 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 Nov 02 10:20:29 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:29 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 Nov 02 10:20:29 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:29 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a 1073741824" returned: 0 in 0.520s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:29 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a Nov 02 10:20:29 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:29 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384" returned: 0 in 0.436s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:29 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94" returned: 0 in 0.477s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:29 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384 Nov 02 10:20:29 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae0eb7-9d8f-457a-8093-70a975bce31a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:29 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba Nov 02 10:20:29 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:29 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a" returned: 0 in 0.318s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:29 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50b01de-d6cc-4e18-9952-2c8127eff62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4c349e-747a-4a52-be77-aebb516a6b7a', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e58bc1-c71a-4c62-9139-971bd292b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-732f0027-c440-40c6-bd32-4f33c1248384" returned: 0 in 0.305s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-quobyte-732f0027-c440-40c6-bd32-4f33c1248384" released by "delete_volume" :: held 0.798s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:29 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Volume volume-bb4c349e-747a-4a52-be77-aebb516a6b7a (bb4c349e-747a-4a52-be77-aebb516a6b7a): created successfully Nov 02 10:20:29 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e58bc1-c71a-4c62-9139-971bd292b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (acbf547e-115d-4d1f-b29f-c65dce8f5007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-590e111a-2745-4722-b690-dbe8932f0c59 tempest-ProjectReaderTests-453018252 None] Created volume successfully. Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Created reservations ['0e8b5a48-d237-441e-bc60-7c2944b5d1ad', '2f8a543b-7d64-48f3-a918-33d60a72dc08', '677e084a-35d2-44c4-a384-5c217e373daf', 'f40d5796-548d-4741-9770-6802febc0584'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:30 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" returned: 0 in 0.473s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:30 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:30 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:30 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 Nov 02 10:20:30 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:30 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:30 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Deleted volume successfully. Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-47ba5e7b-c52f-4cdb-b4c1-465c1041e7be tempest-CreateVolumesFromImageTest-751113892 None] Lock "cinder-732f0027-c440-40c6-bd32-4f33c1248384-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:30 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94" returned: 0 in 0.422s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:30 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94 Nov 02 10:20:30 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Flow 'volume_create_manager' (ed8e58b4-9e1d-4ff0-b331-56ed416d8c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b888de0c-9ba5-4b93-87a0-0e1a1a43ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b888de0c-9ba5-4b93-87a0-0e1a1a43ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-902547118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b35d53-8977-451f-97d1-f5ec4b1a4fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9424e4af6e04cb49b1a014b11efa26e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:31Z,use_quota=True,user_id='1ad5e637d527432d9ded5ce575ef1e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4836a60-0dfd-43e8-a20b-89ce15693206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4836a60-0dfd-43e8-a20b-89ce15693206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bba90f2-d35b-4c82-bb7c-01dc23e2565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bba90f2-d35b-4c82-bb7c-01dc23e2565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b35d53-8977-451f-97d1-f5ec4b1a4fe4', 'volume_name': 'volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a75d02-dbda-406e-8840-6fe15f2450d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a75d02-dbda-406e-8840-6fe15f2450d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a950e55-4fe6-441a-ae01-a221b0e38cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Volume f2b35d53-8977-451f-97d1-f5ec4b1a4fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4', 'volume_size': 1} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-902547118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b35d53-8977-451f-97d1-f5ec4b1a4fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9424e4af6e04cb49b1a014b11efa26e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:31Z,use_quota=True,user_id='1ad5e637d527432d9ded5ce575ef1e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Creating volume f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:30 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:30 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 1073741824 Nov 02 10:20:30 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:30 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba.f7e2a273-afd9-4286-86cb-3ab989f36a94" returned: 0 in 0.263s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-f7e2a273-afd9-4286-86cb-3ab989f36a94" released by "_delete_snapshot" :: held 1.800s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" released by "delete_snapshot" :: held 1.837s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Created reservations ['b6af1c41-ca96-40a2-a156-55632bd40061', 'e91bee31-6dc1-45df-ac9f-3d61a16d856f', '79226715-07fa-477c-8bff-17c913d842c6', 'b7a34d0d-c23d-41f1-8837-72eae396e5db'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-bb4c349e-747a-4a52-be77-aebb516a6b7a-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Lock "cinder-bb4c349e-747a-4a52-be77-aebb516a6b7a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-eedb026f-d067-44ec-9d1a-4e5c39b2bba3 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-f7e2a273-afd9-4286-86cb-3ab989f36a94-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-quobyte-bb4c349e-747a-4a52-be77-aebb516a6b7a" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-bb4c349e-747a-4a52-be77-aebb516a6b7a" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eea9e4-67e1-420d-ae8e-d7693d7b79f0]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:31 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 1073741824" returned: 0 in 0.592s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:31 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a Nov 02 10:20:31 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:31 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 Nov 02 10:20:31 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-8a83f7fd-2687-4e63-84ba-c6c54e01ebba-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:31 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-8a83f7fd-2687-4e63-84ba-c6c54e01ebba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a" returned: 0 in 0.451s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:31 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a Nov 02 10:20:31 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:31 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" returned: 0 in 0.366s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a950e55-4fe6-441a-ae01-a221b0e38cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c449652-5bad-4fd8-8557-b264f5414f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:31 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Volume volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 (f2b35d53-8977-451f-97d1-f5ec4b1a4fe4): created successfully Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c449652-5bad-4fd8-8557-b264f5414f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Flow 'volume_create_manager' (ed8e58b4-9e1d-4ff0-b331-56ed416d8c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ba7696-3776-4a6a-83bc-22b92cd24840]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b79af10b-ac0b-4b45-9210-3155ddddbe0b tempest-VolumeDependencyTests-1235861485 None] Created volume successfully. Nov 02 10:20:32 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba Nov 02 10:20:32 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:32 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-bb4c349e-747a-4a52-be77-aebb516a6b7a" returned: 0 in 0.338s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-bb4c349e-747a-4a52-be77-aebb516a6b7a" released by "delete_volume" :: held 0.848s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Created reservations ['0edd9366-b588-48cd-b4cd-f255452bced6', 'ea15deef-0937-4fe6-8ec3-84f8b3e9f542', '1d492680-7f38-41d3-b58c-6db0b02c817c', '4e4aec3f-6d34-4cba-a9f4-1a5c6c88e26b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:32 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:32 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:32 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" returned: 0 in 0.453s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:32 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba Nov 02 10:20:32 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:32 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.342s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:32 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Deleted volume successfully. Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f04f8420-09d8-4be0-ad1c-923e446785f5 tempest-ProjectReaderTests-453018252 None] Lock "cinder-bb4c349e-747a-4a52-be77-aebb516a6b7a-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:32 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" returned: 0 in 0.345s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-8a83f7fd-2687-4e63-84ba-c6c54e01ebba" released by "delete_volume" :: held 0.904s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Created reservations ['10c7784d-03d7-4578-b75e-41bea7c6af45', '1e9b14a5-f9d7-43c3-9125-c3807674e5be', 'e00d2d4d-94be-4f8a-bf09-5e087bfe3fd8', 'a349f6f2-76d2-432a-94e1-fa6c2af277a7'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:33 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:33 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (e14341d3-4108-420e-8889-b7345960ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e280e1-39f2-4dd3-8a36-be1b063dcb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e280e1-39f2-4dd3-8a36-be1b063dcb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-616526750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e8ba5f-bfb3-4715-980f-4dee0d49166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:33Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441dd850-5149-4cf0-9e78-d6719dff2c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441dd850-5149-4cf0-9e78-d6719dff2c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace78c10-ac87-4f7c-9882-3742d61446cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace78c10-ac87-4f7c-9882-3742d61446cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e8ba5f-bfb3-4715-980f-4dee0d49166d', 'volume_name': 'volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da29807-f3e1-44ad-b000-e05350428ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da29807-f3e1-44ad-b000-e05350428ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a00258-151b-4b50-ae7b-e7fd75e41321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Volume 48e8ba5f-bfb3-4715-980f-4dee0d49166d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d', 'volume_size': 1} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-616526750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e8ba5f-bfb3-4715-980f-4dee0d49166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:33Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Creating volume 48e8ba5f-bfb3-4715-980f-4dee0d49166d {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:33 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:33 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d 1073741824 Nov 02 10:20:33 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:33 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.310s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-05eaea43-1a9f-4004-9022-16dab791519f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-8a83f7fd-2687-4e63-84ba-c6c54e01ebba-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:33 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d 1073741824" returned: 0 in 0.482s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:33 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d Nov 02 10:20:33 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:34 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d" returned: 0 in 0.300s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.808s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a00258-151b-4b50-ae7b-e7fd75e41321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f016721-0411-4dc9-b5d1-be21a3c63a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Creating offline snapshot 45c5a6cf-3074-4467-b7bf-c59b87a14078 of volume f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:34 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Volume volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d (48e8ba5f-bfb3-4715-980f-4dee0d49166d): created successfully Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f016721-0411-4dc9-b5d1-be21a3c63a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (e14341d3-4108-420e-8889-b7345960ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6d4e3-93a3-49ed-9c25-4fc0a1e4c939]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:34 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-374872c7-78fb-41d7-85d7-b69f8f6c2c24 tempest-ProjectReaderTests-453018252 None] Created volume successfully. Nov 02 10:20:34 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 Nov 02 10:20:34 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:34 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" returned: 0 in 0.513s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:34 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 1G Nov 02 10:20:34 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (66df370b-6e2f-42d8-8784-3869e4f48590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bb6b05-8aaa-427d-934f-4caa171ddc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bb6b05-8aaa-427d-934f-4caa171ddc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894304958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609b5743-7cc7-440a-935c-137a5747841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:35Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5691805b-c331-4603-bfe5-50992a596a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5691805b-c331-4603-bfe5-50992a596a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4382f844-9377-470f-81b8-3d3804f59c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4382f844-9377-470f-81b8-3d3804f59c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609b5743-7cc7-440a-935c-137a5747841d', 'volume_name': 'volume-609b5743-7cc7-440a-935c-137a5747841d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b958a4-fb0e-4737-b252-40d9dfc2c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b958a4-fb0e-4737-b252-40d9dfc2c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d6a647-c91f-4595-b8d5-ffc52382539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Volume 609b5743-7cc7-440a-935c-137a5747841d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609b5743-7cc7-440a-935c-137a5747841d', 'volume_size': 1} Nov 02 10:20:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-48e8ba5f-bfb3-4715-980f-4dee0d49166d-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Lock "cinder-48e8ba5f-bfb3-4715-980f-4dee0d49166d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:35 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 1G" returned: 0 in 0.531s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-quobyte-48e8ba5f-bfb3-4715-980f-4dee0d49166d" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:35 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 Nov 02 10:20:35 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-48e8ba5f-bfb3-4715-980f-4dee0d49166d" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecadb414-dce8-44be-a167-366726547863]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d Nov 02 10:20:35 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078" returned: 0 in 0.330s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 is being set with open permissions: ugo+rw Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 Nov 02 10:20:35 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d" returned: 0 in 0.433s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d Nov 02 10:20:35 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.info Nov 02 10:20:35 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-48e8ba5f-bfb3-4715-980f-4dee0d49166d" returned: 0 in 0.285s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-48e8ba5f-bfb3-4715-980f-4dee0d49166d" released by "delete_volume" :: held 0.762s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Created reservations ['401a2445-57a1-44a6-b589-a3868f034997', '2538e368-1cef-484a-8d56-e9ca70fb7466', 'd6b0b594-d467-411f-95f5-553cea5c7b1b', '4924f4fe-76de-481e-8cf0-a340977bd93f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:36 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.info" returned: 0 in 0.271s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.info is being set with open permissions: ugo+rw Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:36 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.info Nov 02 10:20:36 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:36 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:36 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:36 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.253s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Deleted volume successfully. Nov 02 10:20:36 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.info" returned: 0 in 0.299s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894304958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609b5743-7cc7-440a-935c-137a5747841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:35Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Creating volume 609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:36 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:36 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d 1073741824 Nov 02 10:20:36 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-caf6c89a-a187-4a18-8d97-50fd7a862477 tempest-ProjectReaderTests-453018252 None] Lock "cinder-48e8ba5f-bfb3-4715-980f-4dee0d49166d-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ae5d05dc-fe97-4361-ae1a-ec182268a161 tempest-VolumeDependencyTests-1235861485 None] Create snapshot completed successfully Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (b9814e26-b3f4-4376-8818-148b03130ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdb6b63-1288-4513-a82c-e3b0f6678cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdb6b63-1288-4513-a82c-e3b0f6678cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945658700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8846804-75f8-4223-8dc8-1587864dafbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:37Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3414f41-1de2-48b2-a7b7-64fecc160392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3414f41-1de2-48b2-a7b7-64fecc160392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7832990-18ae-403f-a1ff-314c6844a51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7832990-18ae-403f-a1ff-314c6844a51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8846804-75f8-4223-8dc8-1587864dafbe', 'volume_name': 'volume-f8846804-75f8-4223-8dc8-1587864dafbe', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e014f8a6-0793-4fa8-9d8d-5a28761167e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e014f8a6-0793-4fa8-9d8d-5a28761167e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79604ef-4107-41cd-a048-c9a969ae1cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Volume f8846804-75f8-4223-8dc8-1587864dafbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8846804-75f8-4223-8dc8-1587864dafbe', 'volume_size': 1} Nov 02 10:20:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:37 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d 1073741824" returned: 0 in 0.581s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:37 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d Nov 02 10:20:37 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:37 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d" returned: 0 in 0.287s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945658700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8846804-75f8-4223-8dc8-1587864dafbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63f53649a68452e8460f61635292b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:37Z,use_quota=True,user_id='fcedf1f8a9794a2f8826b95d2a5a0341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Creating volume f8846804-75f8-4223-8dc8-1587864dafbe {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:37 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d6a647-c91f-4595-b8d5-ffc52382539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609b5743-7cc7-440a-935c-137a5747841d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:37 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe 1073741824 Nov 02 10:20:37 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9722e5df-a6f1-402b-9d4e-01dd99021ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:37 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Volume volume-609b5743-7cc7-440a-935c-137a5747841d (609b5743-7cc7-440a-935c-137a5747841d): created successfully Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9722e5df-a6f1-402b-9d4e-01dd99021ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (66df370b-6e2f-42d8-8784-3869e4f48590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:37 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-77127500-b6c8-424f-8943-b2c5b1d3ee42 tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:20:38 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe 1073741824" returned: 0 in 0.630s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:38 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe Nov 02 10:20:38 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Flow 'volume_create_manager' (7ab4c277-7921-4526-868a-23a58acdf57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de06b53-474b-413b-8af2-dbf819da3a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de06b53-474b-413b-8af2-dbf819da3a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-746428612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfe53fe-9bda-4e76-a772-949a6a105feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9424e4af6e04cb49b1a014b11efa26e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45c5a6cf-3074-4467-b7bf-c59b87a14078,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:38Z,use_quota=True,user_id='1ad5e637d527432d9ded5ce575ef1e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a0de3b-6b2a-432f-9a39-803b6c381c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a0de3b-6b2a-432f-9a39-803b6c381c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81db2291-266f-4f1a-bf94-6c6e31902ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81db2291-266f-4f1a-bf94-6c6e31902ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7cfe53fe-9bda-4e76-a772-949a6a105feb', 'volume_name': 'volume-7cfe53fe-9bda-4e76-a772-949a6a105feb', 'volume_size': 1, 'snapshot_id': '45c5a6cf-3074-4467-b7bf-c59b87a14078'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab9bc87-2290-4556-8d92-09e65db4b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab9bc87-2290-4556-8d92-09e65db4b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1bf328-4d79-406a-9498-6b9115de0654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Volume 7cfe53fe-9bda-4e76-a772-949a6a105feb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7cfe53fe-9bda-4e76-a772-949a6a105feb', 'volume_size': 1, 'snapshot_id': '45c5a6cf-3074-4467-b7bf-c59b87a14078'} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Flow 'volume_create_manager' (dcacd3f0-d365-4ed4-8714-27642512f420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb5716-0766-4351-ab71-772eff8f04b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb5716-0766-4351-ab71-772eff8f04b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f25dd11-5eea-407d-bdc2-929d49603f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ceda93dc7c4b87b4414da0d415322e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:38Z,use_quota=True,user_id='87588e77273c483c8c5b8698e3421a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44e004d-c8c1-4395-9cbe-fa01c02b9617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44e004d-c8c1-4395-9cbe-fa01c02b9617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2650c0c-d444-4dca-9f61-2f047507891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.image.glance [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Creating Keystone auth plugin from conf {{(pid=87005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:20:38 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe" returned: 0 in 0.271s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.101s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-quobyte-45c5a6cf-3074-4467-b7bf-c59b87a14078-7cfe53fe-9bda-4e76-a772-949a6a105feb" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79604ef-4107-41cd-a048-c9a969ae1cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8846804-75f8-4223-8dc8-1587864dafbe', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b52320-80f2-4ed5-96ea-1dee4b44a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-45c5a6cf-3074-4467-b7bf-c59b87a14078-7cfe53fe-9bda-4e76-a772-949a6a105feb" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Creating volume 7cfe53fe-9bda-4e76-a772-949a6a105feb from snapshot 45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-quobyte-7cfe53fe-9bda-4e76-a772-949a6a105feb" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Volume volume-f8846804-75f8-4223-8dc8-1587864dafbe (f8846804-75f8-4223-8dc8-1587864dafbe): created successfully Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b52320-80f2-4ed5-96ea-1dee4b44a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Flow 'volume_create_manager' (b9814e26-b3f4-4376-8818-148b03130ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-7cfe53fe-9bda-4e76-a772-949a6a105feb" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] snapshot: 45c5a6cf-3074-4467-b7bf-c59b87a14078, volume: 7cfe53fe-9bda-4e76-a772-949a6a105feb, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:20:38 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f5abd1d9-c9fd-4876-810f-91d5163254d1 tempest-ProjectReaderTests-453018252 None] Created volume successfully. Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[97baa072-124a-42c7-af9b-5e40f53ee2b9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:38 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 Nov 02 10:20:38 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2650c0c-d444-4dca-9f61-2f047507891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f25dd11-5eea-407d-bdc2-929d49603f81', 'volume_name': 'volume-8f25dd11-5eea-407d-bdc2-929d49603f81', 'volume_size': 1, 'image_id': '04c77b2c-6bed-4547-a910-35aa7e4d1263', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04c77b2c-6bed-4547-a910-35aa7e4d1263', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e48b6fdefa38948a30db045f2c54059a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54ceda93dc7c4b87b4414da0d415322e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ad099c2adb337dc8ca2ccd7da86bcb04305c6cc6ad7eb981d88989e411b649aa430f8d2306f46530990cd3b30c2b01ede84154d748b5de3d91d09d1b4bff3a4', 'id': '04c77b2c-6bed-4547-a910-35aa7e4d1263', 'created_at': datetime.datetime(2026, 11, 2, 9, 20, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 20, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04c77b2c-6bed-4547-a910-35aa7e4d1263/file', 'properties': {}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b32390-b000-43e1-8653-25a9964c056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b32390-b000-43e1-8653-25a9964c056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ad1eb6-91ad-45c6-abfe-f5a137fb8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Volume 8f25dd11-5eea-407d-bdc2-929d49603f81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f25dd11-5eea-407d-bdc2-929d49603f81', 'volume_size': 1, 'image_id': '04c77b2c-6bed-4547-a910-35aa7e4d1263', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04c77b2c-6bed-4547-a910-35aa7e4d1263', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e48b6fdefa38948a30db045f2c54059a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54ceda93dc7c4b87b4414da0d415322e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ad099c2adb337dc8ca2ccd7da86bcb04305c6cc6ad7eb981d88989e411b649aa430f8d2306f46530990cd3b30c2b01ede84154d748b5de3d91d09d1b4bff3a4', 'id': '04c77b2c-6bed-4547-a910-35aa7e4d1263', 'created_at': datetime.datetime(2026, 11, 2, 9, 20, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 20, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04c77b2c-6bed-4547-a910-35aa7e4d1263/file', 'properties': {}}, 'image_service': } Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Trying to clone 8f25dd11-5eea-407d-bdc2-929d49603f81 from image 04c77b2c-6bed-4547-a910-35aa7e4d1263 at location (None, [{'url': 'file:///opt/stack/data/glance/images/04c77b2c-6bed-4547-a910-35aa7e4d1263', 'metadata': {}}]). {{(pid=87005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:20:38 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e32bb7-0498-4620-b9b4-60ea7319f62b]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:38 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078" returned: 0 in 0.409s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:38 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD Nov 02 10:20:38 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091c574-8cd1-41f4-b8dd-3e621ae91fdc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-f8846804-75f8-4223-8dc8-1587864dafbe-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:39 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 Nov 02 10:20:39 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Lock "cinder-f8846804-75f8-4223-8dc8-1587864dafbe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Acquiring lock "cinder-quobyte-f8846804-75f8-4223-8dc8-1587864dafbe" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-f8846804-75f8-4223-8dc8-1587864dafbe" acquired by "delete_volume" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:39 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaf4546-4824-44bd-97e9-c501f5691c5e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD Nov 02 10:20:39 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe Nov 02 10:20:39 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" returned: 0 in 0.436s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb Nov 02 10:20:39 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Temporary image 04c77b2c-6bed-4547-a910-35aa7e4d1263 is fetched for user 87588e77273c483c8c5b8698e3421a22. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3166c4dd-a596-4787-bab4-2bf8b860ab4a]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe" returned: 0 in 0.420s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe Nov 02 10:20:39 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD Nov 02 10:20:39 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f8846804-75f8-4223-8dc8-1587864dafbe" returned: 0 in 0.357s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Lock "cinder-quobyte-f8846804-75f8-4223-8dc8-1587864dafbe" released by "delete_volume" :: held 0.859s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:40 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Created reservations ['0b40e3a0-04bb-4e91-bcaf-4e2e3e149d69', 'cc8d0d9c-ba9c-4722-9458-06c744ebf4ac', '7ed4ea27-bf95-4c85-9129-2553e88249af', 'a0456811-3b6c-4e55-9855-56086d33b66b'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:40 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:40 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:40 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD Nov 02 10:20:40 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:40 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.429s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:40 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Deleted volume successfully. Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-a0c2c6aa-c9ca-4f2b-8bb6-09cc1d7d9e18 tempest-ProjectReaderTests-453018252 None] Lock "cinder-f8846804-75f8-4223-8dc8-1587864dafbe-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:40 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD" returned: 1 in 0.845s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:46 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb" returned: 0 in 6.657s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:20:46 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Converted 1024.00 MB image at 153.80 MB/s Nov 02 10:20:46 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb is being set with open permissions: ugo+rw Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb Nov 02 10:20:46 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb" returned: 0 in 0.223s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-7cfe53fe-9bda-4e76-a772-949a6a105feb" released by "_copy_volume_from_snapshot" :: held 7.841s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=222,cinder:UPDATE=316,cinder:DELETE=25,cinder:INSERT=64 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=277,cinder:SELECT=204,cinder:INSERT=85,cinder:DELETE=29 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-45c5a6cf-3074-4467-b7bf-c59b87a14078-7cfe53fe-9bda-4e76-a772-949a6a105feb" released by "_create_volume_from_snapshot" :: held 7.917s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.954s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 0c565559-f048-4af1-ae5e-986a1e4bceb0 of volume 609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1bf328-4d79-406a-9498-6b9115de0654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfe53fe-9bda-4e76-a772-949a6a105feb', 'volume_size': 1, 'snapshot_id': '45c5a6cf-3074-4467-b7bf-c59b87a14078'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faac063-ddb0-4a72-9ce5-06106dc76b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff4e30-1d48-483b-a996-4e6cf094423f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Volume volume-7cfe53fe-9bda-4e76-a772-949a6a105feb (7cfe53fe-9bda-4e76-a772-949a6a105feb): created successfully Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faac063-ddb0-4a72-9ce5-06106dc76b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Flow 'volume_create_manager' (7ab4c277-7921-4526-868a-23a58acdf57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-01f1caa1-b148-4665-8314-3c81d07a0cff tempest-VolumeDependencyTests-1235861485 None] Created volume successfully. Nov 02 10:20:46 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d Nov 02 10:20:46 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-45c5a6cf-3074-4467-b7bf-c59b87a14078-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-45c5a6cf-3074-4467-b7bf-c59b87a14078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-quobyte-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-quobyte-45c5a6cf-3074-4467-b7bf-c59b87a14078" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-45c5a6cf-3074-4467-b7bf-c59b87a14078" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Deleting offline snapshot 45c5a6cf-3074-4467-b7bf-c59b87a14078 of volume f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] snapshot_file for this snap is: volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[374cc73c-58f5-4c61-a80b-6dcba2d385d3]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d" returned: 0 in 0.396s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 1G Nov 02 10:20:46 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 Nov 02 10:20:46 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 1G" returned: 0 in 0.381s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-609b5743-7cc7-440a-935c-137a5747841d -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[96791611-a111-46f2-bf9c-af99aebe2145]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-609b5743-7cc7-440a-935c-137a5747841d -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 Nov 02 10:20:47 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 Nov 02 10:20:47 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-609b5743-7cc7-440a-935c-137a5747841d -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0" returned: 0 in 0.301s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 is being set with open permissions: ugo+rw Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 Nov 02 10:20:47 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" returned: 0 in 0.558s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 Nov 02 10:20:47 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.info Nov 02 10:20:47 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.info" returned: 0 in 0.242s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.info is being set with open permissions: ugo+rw Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.info Nov 02 10:20:48 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078" returned: 0 in 0.333s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078 Nov 02 10:20:48 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.info" returned: 0 in 0.238s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.374s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f25dd11-5eea-407d-bdc2-929d49603f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ceda93dc7c4b87b4414da0d415322e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:38Z,use_quota=True,user_id='87588e77273c483c8c5b8698e3421a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Creating volume 8f25dd11-5eea-407d-bdc2-929d49603f81 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:48 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4.45c5a6cf-3074-4467-b7bf-c59b87a14078" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 1073741824 Nov 02 10:20:48 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-45c5a6cf-3074-4467-b7bf-c59b87a14078" released by "_delete_snapshot" :: held 1.623s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" released by "delete_snapshot" :: held 1.657s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-da8b9f7d-c00c-4fce-9576-77c0ba3c155a tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Created reservations ['5e2c244c-fc26-4edb-a090-12197ae5a13d', '9ff981de-6426-49d0-8467-9892a91a7d2b', 'f9bc258d-f415-4676-a81d-53d8a90432b3', 'a288251d-192e-4a8d-886a-17abbd037b9d'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Delete snapshot completed successfully. Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-3dcaf159-7b8b-49f2-95f9-74471542895c tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-45c5a6cf-3074-4467-b7bf-c59b87a14078-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:48 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 1073741824" returned: 0 in 0.435s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-0c565559-f048-4af1-ae5e-986a1e4bceb0-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-0c565559-f048-4af1-ae5e-986a1e4bceb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-609b5743-7cc7-440a-935c-137a5747841d" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-609b5743-7cc7-440a-935c-137a5747841d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-0c565559-f048-4af1-ae5e-986a1e4bceb0" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:48 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 Nov 02 10:20:48 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-0c565559-f048-4af1-ae5e-986a1e4bceb0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 0c565559-f048-4af1-ae5e-986a1e4bceb0 of volume 609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d208fd1e-7b0f-4476-be10-7d6c2ec5e52e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:48 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:48 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-quobyte-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:49 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 Nov 02 10:20:49 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95602bd-2db1-4e45-887c-75fcdd67bcd5]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81" returned: 0 in 0.309s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Attempting download of 04c77b2c-6bed-4547-a910-35aa7e4d1263 ((None, [{'url': 'file:///opt/stack/data/glance/images/04c77b2c-6bed-4547-a910-35aa7e4d1263', 'metadata': {}}])) to volume 8f25dd11-5eea-407d-bdc2-929d49603f81. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:20:49 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 Nov 02 10:20:49 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083d9a7-d736-46eb-8cff-21805a92ed8a]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04c77b2c-6bed-4547-a910-35aa7e4d1263_20n10kbi {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.322s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:20:49 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04c77b2c-6bed-4547-a910-35aa7e4d1263_20n10kbi Nov 02 10:20:49 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0" returned: 0 in 0.471s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-609b5743-7cc7-440a-935c-137a5747841d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[88809a65-77f8-4cad-8e0d-eb817b209dc8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" returned: 0 in 0.419s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4 Nov 02 10:20:49 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d Nov 02 10:20:49 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04c77b2c-6bed-4547-a910-35aa7e4d1263_20n10kbi" returned: 0 in 0.362s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04c77b2c-6bed-4547-a910-35aa7e4d1263_20n10kbi {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04c77b2c-6bed-4547-a910-35aa7e4d1263_20n10kbi Nov 02 10:20:49 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" returned: 0 in 0.255s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4" released by "delete_volume" :: held 0.740s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:49 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d" returned: 0 in 0.393s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Created reservations ['ef97b39b-75e1-476f-95e2-7977d4e861fe', '05e08e95-6bc6-4810-997f-bf86b217e26b', '495bad05-893f-4485-b6ee-6b6ebd9fc058', '8a054b85-bdd5-48a7-8a5a-17ee010ef963'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:49 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 Nov 02 10:20:49 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:49 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04c77b2c-6bed-4547-a910-35aa7e4d1263_20n10kbi" returned: 1 in 0.373s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04c77b2c-6bed-4547-a910-35aa7e4d1263_20n10kbi' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b694b2c2-45bd-4b71-a387-c29d74e2da4b]: (4, 'raw') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:49 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-7cfe53fe-9bda-4e76-a772-949a6a105feb-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:50 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD Nov 02 10:20:50 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-7cfe53fe-9bda-4e76-a772-949a6a105feb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "cinder-quobyte-7cfe53fe-9bda-4e76-a772-949a6a105feb" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-7cfe53fe-9bda-4e76-a772-949a6a105feb" acquired by "delete_volume" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914f52d-2236-4a4c-912d-ae199287092a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:50 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.314s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Deleted volume successfully. Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-014cb92c-64ff-497d-a263-133330528cff tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-f2b35d53-8977-451f-97d1-f5ec4b1a4fe4-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:50 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0" returned: 0 in 0.493s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:50 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0 Nov 02 10:20:50 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb Nov 02 10:20:50 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:50 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD Nov 02 10:20:50 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d.0c565559-f048-4af1-ae5e-986a1e4bceb0" returned: 0 in 0.272s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb" returned: 0 in 0.397s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-0c565559-f048-4af1-ae5e-986a1e4bceb0" released by "_delete_snapshot" :: held 1.787s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-609b5743-7cc7-440a-935c-137a5747841d" released by "delete_snapshot" :: held 1.822s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:50 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb Nov 02 10:20:50 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Created reservations ['59d445dc-a060-4e3a-9a2b-51f5aa4e614f', '5dc4d1ab-5197-4a9d-bf4e-782568337cc8', '56694f67-4a5f-4b18-873c-3ee44e5495a7', '3f4fe731-6304-470e-a1fa-113cb18f3734'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:20:50 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-c0611844-691e-40c2-ae78-85d8639256e4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-0c565559-f048-4af1-ae5e-986a1e4bceb0-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] 04c77b2c-6bed-4547-a910-35aa7e4d1263 was raw, converting to qcow2 {{(pid=87005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:50 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 Nov 02 10:20:50 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7cfe53fe-9bda-4e76-a772-949a6a105feb" returned: 0 in 0.289s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-609b5743-7cc7-440a-935c-137a5747841d-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-quobyte-7cfe53fe-9bda-4e76-a772-949a6a105feb" released by "delete_volume" :: held 0.759s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-609b5743-7cc7-440a-935c-137a5747841d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-609b5743-7cc7-440a-935c-137a5747841d" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Created reservations ['75c5bc93-72d1-4359-802e-a73a4b69efc0', 'ad8532b4-07c6-4817-9bc2-36c62e51e5e8', 'ec799e76-c9cf-464d-9fcd-7297a8d742e8', '04e090fc-fa39-4d13-b174-2d003f0cf964'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-609b5743-7cc7-440a-935c-137a5747841d" acquired by "delete_volume" :: waited 0.033s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da22da0-84f6-4c54-992e-84833034b1f8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:51 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:51 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:51 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d Nov 02 10:20:51 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:51 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81" returned: 0 in 0.586s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04c77b2c-6bed-4547-a910-35aa7e4d1263_vgvf2_qndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:20:51 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:51 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 1G Nov 02 10:20:51 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:51 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.294s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Deleted volume successfully. Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-8d20950a-b2d8-480a-9671-64aa1e26d19f tempest-VolumeDependencyTests-1235861485 None] Lock "cinder-7cfe53fe-9bda-4e76-a772-949a6a105feb-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:51 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d" returned: 0 in 0.449s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:51 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d Nov 02 10:20:51 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:51 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 1G" returned: 0 in 0.362s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Downloaded image 04c77b2c-6bed-4547-a910-35aa7e4d1263 ((None, [{'url': 'file:///opt/stack/data/glance/images/04c77b2c-6bed-4547-a910-35aa7e4d1263', 'metadata': {}}])) to volume 8f25dd11-5eea-407d-bdc2-929d49603f81 successfully. {{(pid=87005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Temporary image 04c77b2c-6bed-4547-a910-35aa7e4d1263 for user 87588e77273c483c8c5b8698e3421a22 is deleted. {{(pid=87005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.volume_utils [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Marking volume 8f25dd11-5eea-407d-bdc2-929d49603f81 as bootable. {{(pid=87005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Copying metadata from image 04c77b2c-6bed-4547-a910-35aa7e4d1263 to 8f25dd11-5eea-407d-bdc2-929d49603f81. {{(pid=87005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Creating volume glance metadata for volume 8f25dd11-5eea-407d-bdc2-929d49603f81 backed by image 04c77b2c-6bed-4547-a910-35aa7e4d1263 with: {'image_id': '04c77b2c-6bed-4547-a910-35aa7e4d1263', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e48b6fdefa38948a30db045f2c54059a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ad1eb6-91ad-45c6-abfe-f5a137fb8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f25dd11-5eea-407d-bdc2-929d49603f81', 'volume_size': 1, 'image_id': '04c77b2c-6bed-4547-a910-35aa7e4d1263', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04c77b2c-6bed-4547-a910-35aa7e4d1263', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e48b6fdefa38948a30db045f2c54059a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54ceda93dc7c4b87b4414da0d415322e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ad099c2adb337dc8ca2ccd7da86bcb04305c6cc6ad7eb981d88989e411b649aa430f8d2306f46530990cd3b30c2b01ede84154d748b5de3d91d09d1b4bff3a4', 'id': '04c77b2c-6bed-4547-a910-35aa7e4d1263', 'created_at': datetime.datetime(2026, 11, 2, 9, 20, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 20, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04c77b2c-6bed-4547-a910-35aa7e4d1263/file', 'properties': {}}, 'image_service': }' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db4fb56-fde0-455d-b06f-514038421768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:51 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Volume volume-8f25dd11-5eea-407d-bdc2-929d49603f81 (8f25dd11-5eea-407d-bdc2-929d49603f81): created successfully Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db4fb56-fde0-455d-b06f-514038421768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Flow 'volume_create_manager' (dcacd3f0-d365-4ed4-8714-27642512f420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:51 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-609b5743-7cc7-440a-935c-137a5747841d" returned: 0 in 0.295s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-287c5895-4dc6-4b90-b0f9-f58d10bb1273 tempest-VolumeImageDependencyTests-1202017726 None] Created volume successfully. Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-609b5743-7cc7-440a-935c-137a5747841d" released by "delete_volume" :: held 0.828s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Created reservations ['f9eb47c8-1d8a-4321-a8ef-6b81f4e42292', 'ed95b6cf-15a0-40f8-9586-c380935afa37', '574d68fd-0af2-40be-bd6e-77cc82965a91', 'd9628bf3-1a49-4668-a193-b9206ee653a2'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:52 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Acquiring lock "cinder-8f25dd11-5eea-407d-bdc2-929d49603f81-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Lock "cinder-8f25dd11-5eea-407d-bdc2-929d49603f81-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:52 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Acquiring lock "cinder-quobyte-8f25dd11-5eea-407d-bdc2-929d49603f81" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:52 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Lock "cinder-quobyte-8f25dd11-5eea-407d-bdc2-929d49603f81" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-6647747b-7156-4f3f-bc88-57bd4d8acf17 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-609b5743-7cc7-440a-935c-137a5747841d-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fe6083-771a-4621-a2c9-92d225e96e62]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 Nov 02 10:20:52 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (180d01be-a752-4c09-90db-6c0b54275d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09796516-9246-4f09-bfc9-e80b0ba7be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09796516-9246-4f09-bfc9-e80b0ba7be1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366259513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:53Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62154340-c3e3-4d31-87de-f21d83dc2318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62154340-c3e3-4d31-87de-f21d83dc2318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fea5ac-0230-4b42-9fe4-51f6cb7b99f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fea5ac-0230-4b42-9fe4-51f6cb7b99f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4', 'volume_name': 'volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbcf40e-99d4-402b-b1e9-a69b709e6cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbcf40e-99d4-402b-b1e9-a69b709e6cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e235aec-1ca0-43fa-af60-0da412db6901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:52 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Volume ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4', 'volume_size': 1} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366259513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:53Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Creating volume ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:52 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 1073741824 Nov 02 10:20:52 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:52 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81" returned: 0 in 0.446s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81 Nov 02 10:20:52 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:53 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-8f25dd11-5eea-407d-bdc2-929d49603f81" returned: 0 in 0.293s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Lock "cinder-quobyte-8f25dd11-5eea-407d-bdc2-929d49603f81" released by "delete_volume" :: held 0.802s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Created reservations ['702a814c-0294-48a4-bc9a-e85cd68c1d9f', '85b1f8e9-1707-45ff-b031-5d5797666de6', '5cc4b59c-bbb3-4a14-9403-b284b22ed444', 'c6833bdd-69d7-4fbb-b81f-37e00ca11805'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:53 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:20:53 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:53 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 1073741824" returned: 0 in 0.552s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:53 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 Nov 02 10:20:53 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:53 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.348s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Deleted volume successfully. Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-68f5fd7f-0e79-4b91-aa23-e241006d3d7b tempest-VolumeImageDependencyTests-1202017726 None] Lock "cinder-8f25dd11-5eea-407d-bdc2-929d49603f81-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:53 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" returned: 0 in 0.338s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e235aec-1ca0-43fa-af60-0da412db6901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1e0881-f772-44f4-b680-1b53c9eb038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:53 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Volume volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 (ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4): created successfully Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1e0881-f772-44f4-b680-1b53c9eb038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:53 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (180d01be-a752-4c09-90db-6c0b54275d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:53 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-24a170f3-78ca-4077-bf42-88749b5c9334 tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Flow 'volume_create_manager' (1e70befa-d522-4594-acc6-007380a47fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b73f8b-84e7-4350-a664-7cc3b2368e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b73f8b-84e7-4350-a664-7cc3b2368e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea5825d-fe18-4666-8c4c-32a6335dd59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4099685763914537b51601594d9a2388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:55Z,use_quota=True,user_id='7e535204e2cc415899cfb13ca7b9c2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab9087-f44c-4666-9d68-0c3293148f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab9087-f44c-4666-9d68-0c3293148f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2c1a8f-8e02-4001-aab9-065efd670d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2c1a8f-8e02-4001-aab9-065efd670d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea5825d-fe18-4666-8c4c-32a6335dd59d', 'volume_name': 'volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6330daab-66df-4a01-880b-6e3365a2d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6330daab-66df-4a01-880b-6e3365a2d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be20f3d5-3140-4585-b587-1883312ec313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Volume 3ea5825d-fe18-4666-8c4c-32a6335dd59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d', 'volume_size': 1} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea5825d-fe18-4666-8c4c-32a6335dd59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4099685763914537b51601594d9a2388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:55Z,use_quota=True,user_id='7e535204e2cc415899cfb13ca7b9c2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Creating volume 3ea5825d-fe18-4666-8c4c-32a6335dd59d {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:54 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d 1073741824 Nov 02 10:20:55 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:55 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d 1073741824" returned: 0 in 0.488s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d Nov 02 10:20:55 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.733s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be20f3d5-3140-4585-b587-1883312ec313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253bd646-b5c6-49c9-a6fa-5ae68db89bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 08e4c782-8b2b-43b8-af2b-83b0300f4701 of volume ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:55 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Volume volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d (3ea5825d-fe18-4666-8c4c-32a6335dd59d): created successfully Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253bd646-b5c6-49c9-a6fa-5ae68db89bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Flow 'volume_create_manager' (1e70befa-d522-4594-acc6-007380a47fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe129be8-9de0-4a2e-b571-3ff35ba48b09]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:55 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fdf07308-9a1f-4f65-a90c-c683782bcff4 tempest-CinderUnicodeTest-1526474176 None] Created volume successfully. Nov 02 10:20:55 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 Nov 02 10:20:55 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:56 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" returned: 0 in 0.394s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:56 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 1G Nov 02 10:20:56 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:56 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 1G" returned: 0 in 0.442s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:56 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 Nov 02 10:20:56 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701" returned: 0 in 0.326s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:57 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 is being set with open permissions: ugo+rw Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:57 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 Nov 02 10:20:57 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701" returned: 0 in 0.293s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:57 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.info Nov 02 10:20:57 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Flow 'volume_create_manager' (0dcacba1-e087-4e23-809c-4c8c07ee378a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8768dc2f-d827-4ed3-b58b-df4463a5713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8768dc2f-d827-4ed3-b58b-df4463a5713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1976875951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641da49c-8bdb-47df-8e27-6a276cdfa8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4099685763914537b51601594d9a2388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:57Z,use_quota=True,user_id='7e535204e2cc415899cfb13ca7b9c2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2854f84b-c788-4fe8-88be-173938786dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2854f84b-c788-4fe8-88be-173938786dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd0cab4-7dcd-4489-bc6d-4cc89653876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd0cab4-7dcd-4489-bc6d-4cc89653876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641da49c-8bdb-47df-8e27-6a276cdfa8f0', 'volume_name': 'volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd317540-9f83-49ca-82ff-f3fda7a01964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd317540-9f83-49ca-82ff-f3fda7a01964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:57 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8617f113-fcee-4584-be8d-b2ca0dfacce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:57 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Volume 641da49c-8bdb-47df-8e27-6a276cdfa8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0', 'volume_size': 1} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.info" returned: 0 in 0.295s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:57 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.info is being set with open permissions: ugo+rw Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:57 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.info Nov 02 10:20:57 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.info" returned: 0 in 0.242s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1976875951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641da49c-8bdb-47df-8e27-6a276cdfa8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4099685763914537b51601594d9a2388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:57Z,use_quota=True,user_id='7e535204e2cc415899cfb13ca7b9c2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Creating volume 641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:57 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:20:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:57 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 1073741824 Nov 02 10:20:57 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-264c5e73-a2f2-4962-934d-b2fd120d7030 tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-08e4c782-8b2b-43b8-af2b-83b0300f4701-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-08e4c782-8b2b-43b8-af2b-83b0300f4701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-08e4c782-8b2b-43b8-af2b-83b0300f4701" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-08e4c782-8b2b-43b8-af2b-83b0300f4701" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 08e4c782-8b2b-43b8-af2b-83b0300f4701 of volume ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035ed17-1337-4cd1-be52-1a9630cb3e16]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:58 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 1073741824" returned: 0 in 0.537s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:58 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 Nov 02 10:20:58 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:58 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 Nov 02 10:20:58 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:58 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701" returned: 0 in 0.442s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:58 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0" returned: 0 in 0.308s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bfaff1-fc43-438a-8ffe-ac5009d7631a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8617f113-fcee-4584-be8d-b2ca0dfacce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eee696-3f91-4fba-81bb-5d334977f729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:58 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Volume volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 (641da49c-8bdb-47df-8e27-6a276cdfa8f0): created successfully Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eee696-3f91-4fba-81bb-5d334977f729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:58 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Flow 'volume_create_manager' (0dcacba1-e087-4e23-809c-4c8c07ee378a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:58 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9e055f45-989c-4af1-aa87-d30c14eec93f tempest-CinderUnicodeTest-1526474176 None] Created volume successfully. Nov 02 10:20:58 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 Nov 02 10:20:58 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:59 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" returned: 0 in 0.381s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:59 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 Nov 02 10:20:59 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:59 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701" returned: 0 in 0.421s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:59 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701 Nov 02 10:20:59 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:59 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4.08e4c782-8b2b-43b8-af2b-83b0300f4701" returned: 0 in 0.300s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-08e4c782-8b2b-43b8-af2b-83b0300f4701" released by "_delete_snapshot" :: held 1.722s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" released by "delete_snapshot" :: held 1.777s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Creating offline snapshot 8446b96f-80a1-440a-97ec-3d2f3b3a938b of volume 641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07f0edb-4b78-4bea-b136-efb071984676]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Created reservations ['b1dd38b1-f77a-4cc0-b8b5-0ae1d16903f1', '12ba3072-c5fe-47fe-801a-04c7a36c6f58', 'b8c044c0-5bd1-47ee-b80c-e90ead508242', '02f7b58f-15fe-4f34-8c42-ce6482090419'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb8d65f2-b518-403b-8620-ba3b029ffeb6 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-08e4c782-8b2b-43b8-af2b-83b0300f4701-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:00 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 Nov 02 10:21:00 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Lock "cinder-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0" returned: 0 in 0.503s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3731452e-0b6b-4619-b173-65a9eea98b5e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:00 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b 1G Nov 02 10:21:00 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:00 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 Nov 02 10:21:00 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" returned: 0 in 0.425s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b 1G" returned: 0 in 0.476s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4 Nov 02 10:21:01 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b Nov 02 10:21:01 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" returned: 0 in 0.288s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4" released by "delete_volume" :: held 0.794s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Created reservations ['d4149e59-4512-42cc-9af8-0b1c43f4ff8a', '919e73b5-7200-4df3-b2f5-78a6a7c87262', '5cc1379e-5171-4c32-a146-3728d9378acf', '7f531a5f-a4a2-4d23-b7d9-76e669b6c6a0'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:01 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b" returned: 0 in 0.342s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b is being set with open permissions: ugo+rw Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b Nov 02 10:21:01 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:01 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b" returned: 0 in 0.284s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.info Nov 02 10:21:01 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.292s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:21:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-2d32b50d-6be4-4df6-97bb-826d835bfc5e tempest-ProjectMemberTests-2033426512 None] Lock "cinder-ce3fe831-a3e5-4f0f-b6be-909c8d6d50d4-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:02 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.info" returned: 0 in 0.354s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.info is being set with open permissions: ugo+rw Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.info Nov 02 10:21:02 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (6ce0887b-f854-4be9-ab93-8a4338ebbd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f3551b-accb-47b1-b17c-f8d1ef83765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f3551b-accb-47b1-b17c-f8d1ef83765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979004192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaa183f-d5b8-4e6f-bf84-937b6cab5abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:02Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9073afb1-9131-44ee-ac93-0bfc43ffb332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9073afb1-9131-44ee-ac93-0bfc43ffb332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f63258-8802-401d-96ca-d0ed11e82c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f63258-8802-401d-96ca-d0ed11e82c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beaa183f-d5b8-4e6f-bf84-937b6cab5abf', 'volume_name': 'volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4e1dea-c2e8-45e4-bd5e-f9d62359b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4e1dea-c2e8-45e4-bd5e-f9d62359b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8722cee1-9daf-4316-9653-a825866a230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:02 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Volume beaa183f-d5b8-4e6f-bf84-937b6cab5abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf', 'volume_size': 1} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:02 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.info" returned: 0 in 0.281s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979004192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaa183f-d5b8-4e6f-bf84-937b6cab5abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:02Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Creating volume beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:02 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf 1073741824 Nov 02 10:21:02 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d19fe9b1-e7b3-47dc-bf59-d7b432570535 tempest-CinderUnicodeTest-1526474176 None] Create snapshot completed successfully Nov 02 10:21:02 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf 1073741824" returned: 0 in 0.575s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:03 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf Nov 02 10:21:03 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "cinder-8446b96f-80a1-440a-97ec-3d2f3b3a938b-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-8446b96f-80a1-440a-97ec-3d2f3b3a938b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "cinder-quobyte-641da49c-8bdb-47df-8e27-6a276cdfa8f0" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-641da49c-8bdb-47df-8e27-6a276cdfa8f0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "cinder-quobyte-8446b96f-80a1-440a-97ec-3d2f3b3a938b" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-8446b96f-80a1-440a-97ec-3d2f3b3a938b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Deleting offline snapshot 8446b96f-80a1-440a-97ec-3d2f3b3a938b of volume 641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] snapshot_file for this snap is: volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:03 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6fb0e-b9ef-4e1d-9895-30677903bfbe]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" returned: 0 in 0.288s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8722cee1-9daf-4316-9653-a825866a230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68525a37-9a8a-43b9-818c-e645b68c1fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:03 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Volume volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf (beaa183f-d5b8-4e6f-bf84-937b6cab5abf): created successfully Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68525a37-9a8a-43b9-818c-e645b68c1fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (6ce0887b-f854-4be9-ab93-8a4338ebbd51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:03 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4eb64d9e-bce8-4336-a6b5-7fb49253146c tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:21:03 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b Nov 02 10:21:03 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:03 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[27281dd2-71a7-46cb-91df-8583ebf3f8c7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:03 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:03 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 Nov 02 10:21:03 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0" returned: 0 in 0.375s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b Nov 02 10:21:04 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 of volume beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:04 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b" returned: 0 in 0.433s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f710b19-a513-41e1-98ea-791fc0c823d6]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b Nov 02 10:21:04 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf Nov 02 10:21:04 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0.8446b96f-80a1-440a-97ec-3d2f3b3a938b" returned: 0 in 0.275s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-8446b96f-80a1-440a-97ec-3d2f3b3a938b" released by "_delete_snapshot" :: held 1.601s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-641da49c-8bdb-47df-8e27-6a276cdfa8f0" released by "delete_snapshot" :: held 1.625s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Created reservations ['c2e2fe86-1d07-493c-8771-ff87d12f0177', 'd8243675-91a9-45ea-9490-ea3315b58d69', 'aca20c56-03cd-469e-af62-22953477f0c9', '2f894689-81d8-4d7e-bf5b-cb0c8fe4a243'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:04 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" returned: 0 in 0.444s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 1G Nov 02 10:21:05 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:05 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Delete snapshot completed successfully. Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5e43ffa4-2bca-425c-8b39-a70fbc0e43b3 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-8446b96f-80a1-440a-97ec-3d2f3b3a938b-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "cinder-641da49c-8bdb-47df-8e27-6a276cdfa8f0-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-641da49c-8bdb-47df-8e27-6a276cdfa8f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:05 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 1G" returned: 0 in 0.432s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 Nov 02 10:21:05 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "cinder-quobyte-641da49c-8bdb-47df-8e27-6a276cdfa8f0" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-641da49c-8bdb-47df-8e27-6a276cdfa8f0" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ed0f61-2483-415a-aeae-63a46d29d975]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 Nov 02 10:21:05 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:05 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" returned: 0 in 0.340s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 is being set with open permissions: ugo+rw Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 Nov 02 10:21:05 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:05 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0" returned: 0 in 0.368s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0 Nov 02 10:21:05 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" returned: 0 in 0.260s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:06 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.info Nov 02 10:21:06 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-641da49c-8bdb-47df-8e27-6a276cdfa8f0" returned: 0 in 0.284s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-641da49c-8bdb-47df-8e27-6a276cdfa8f0" released by "delete_volume" :: held 0.743s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:06 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.info" returned: 0 in 0.261s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.info is being set with open permissions: ugo+rw Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:06 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.info Nov 02 10:21:06 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Created reservations ['759f81fa-7ea4-4931-a7f7-62f8ebbab886', 'b9cf5da1-0eef-4e0a-8911-5394b65f79fd', '2a9e94a4-8b74-4194-81d7-0b0acd09e037', '49f773dc-97da-4b43-a448-0a7067b7664c'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:06 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:06 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.info" returned: 0 in 0.283s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "cinder-3ea5825d-fe18-4666-8c4c-32a6335dd59d-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-3ea5825d-fe18-4666-8c4c-32a6335dd59d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-7b9693a2-ca24-41e0-aa20-72ef9fe5dbb8 tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "cinder-quobyte-3ea5825d-fe18-4666-8c4c-32a6335dd59d" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:06 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-3ea5825d-fe18-4666-8c4c-32a6335dd59d" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.343s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:06 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Deleted volume successfully. Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac444c5-c299-4819-8c91-bbd9dd74f4e7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:06 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-db8f2732-97a5-454f-9cfd-b2548b28a2c5 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-641da49c-8bdb-47df-8e27-6a276cdfa8f0-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:06 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d Nov 02 10:21:06 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:07 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d" returned: 0 in 0.364s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:07 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d Nov 02 10:21:07 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:07 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-3ea5825d-fe18-4666-8c4c-32a6335dd59d" returned: 0 in 0.239s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-quobyte-3ea5825d-fe18-4666-8c4c-32a6335dd59d" released by "delete_volume" :: held 0.659s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Created reservations ['e3580f96-f227-4d60-b98c-3738f91985c3', '41cccc52-ffab-498b-8fda-dfabd0b9c0cb', 'b13bc81a-80bc-43e3-ae2a-ba4aa82b3a2f', '6a26dba9-ae72-42d1-9bc7-cc00ce1e38bc'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:07 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:07 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-5b6b0857-7abc-4aa7-b7bd-a14e53ae1564-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-5b6b0857-7abc-4aa7-b7bd-a14e53ae1564-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 of volume beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1733d78a-5086-469c-a58e-eeb003508e9a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:07 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:07 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Deleted volume successfully. Nov 02 10:21:07 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bd7f87a8-9d69-4f32-9299-d82f47eef0d7 tempest-CinderUnicodeTest-1526474176 None] Lock "cinder-3ea5825d-fe18-4666-8c4c-32a6335dd59d-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:07 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 Nov 02 10:21:07 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:08 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" returned: 0 in 0.413s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:08 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:08 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5357870-b2bf-4d0f-b914-278f45e7fbb8]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:08 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf Nov 02 10:21:08 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:08 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" returned: 0 in 0.414s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:08 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:08 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 Nov 02 10:21:08 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:09 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" returned: 0 in 0.413s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:09 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564 Nov 02 10:21:09 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:09 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf.5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-5b6b0857-7abc-4aa7-b7bd-a14e53ae1564" released by "_delete_snapshot" :: held 1.670s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" released by "delete_snapshot" :: held 1.703s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Created reservations ['4aef905f-0ee8-4738-8b3c-be74d6020b39', 'cf759bf0-72f9-4f70-92d8-49d1691ebfd4', '608ad06c-b897-4376-a144-6c130fa15e24', '624072df-4ea4-43ab-bd7d-b8e61bac51e8'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:09 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-73169dc2-2aab-4334-8802-aaefe6a81f08 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-5b6b0857-7abc-4aa7-b7bd-a14e53ae1564-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-beaa183f-d5b8-4e6f-bf84-937b6cab5abf-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-beaa183f-d5b8-4e6f-bf84-937b6cab5abf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e057d-2e56-4200-85a7-6225c0fb590a]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:09 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:10 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf Nov 02 10:21:10 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:10 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" returned: 0 in 0.428s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:10 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf Nov 02 10:21:10 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:10 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-beaa183f-d5b8-4e6f-bf84-937b6cab5abf" released by "delete_volume" :: held 0.786s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Created reservations ['49668157-179c-4819-8617-0631b522cf1d', 'a59abf08-1452-4e34-9a50-6d5068d95456', '21ba877f-b88e-4750-9bb8-266725921554', '96170c44-3113-40f3-bd0a-8a526367faf0'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:10 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:10 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:10 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:11 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.275s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:11 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-bb6c139d-eac6-4766-83ca-1c0f2ec9bdf1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-beaa183f-d5b8-4e6f-bf84-937b6cab5abf-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (2aeb3c54-61ff-40fc-921d-d606f74f2afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3da2235-66c0-4856-b3cb-c653907ddca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3da2235-66c0-4856-b3cb-c653907ddca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688872243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e25a69d-db92-4010-ad7e-5ff03c12e2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:11Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652f6cbd-863c-4b88-a573-f15f3696c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652f6cbd-863c-4b88-a573-f15f3696c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4bff2a-4d06-4435-9d85-e5a26626aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4bff2a-4d06-4435-9d85-e5a26626aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e25a69d-db92-4010-ad7e-5ff03c12e2fd', 'volume_name': 'volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e01b402-dfeb-45f7-b5fd-eb99ffffd64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e01b402-dfeb-45f7-b5fd-eb99ffffd64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfd4d7f-1adc-4216-8191-8638d0a4a845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:11 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Volume 7e25a69d-db92-4010-ad7e-5ff03c12e2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd', 'volume_size': 1} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688872243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e25a69d-db92-4010-ad7e-5ff03c12e2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:11Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Creating volume 7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:11 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:11 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:11 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd 1073741824 Nov 02 10:21:11 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (6388acf8-55e2-4e1c-99ef-7106975361af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:12 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf68e661-c8c9-4b7e-8b4c-e759526110c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd 1073741824" returned: 0 in 0.501s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf68e661-c8c9-4b7e-8b4c-e759526110c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17116841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50ff999-98fa-4519-bd8a-eb87ede52d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:12Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908a642b-fb07-4a7e-b724-e355db084114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908a642b-fb07-4a7e-b724-e355db084114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593ab7d2-32eb-48dc-af71-307759c1bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593ab7d2-32eb-48dc-af71-307759c1bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50ff999-98fa-4519-bd8a-eb87ede52d16', 'volume_name': 'volume-f50ff999-98fa-4519-bd8a-eb87ede52d16', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded6e3a7-ac2c-423b-8e3f-c677fa43bd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded6e3a7-ac2c-423b-8e3f-c677fa43bd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f213eb-e0f3-4644-857f-2971201c1feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:12 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Volume f50ff999-98fa-4519-bd8a-eb87ede52d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50ff999-98fa-4519-bd8a-eb87ede52d16', 'volume_size': 1} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:12 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd Nov 02 10:21:12 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:12 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.275s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17116841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50ff999-98fa-4519-bd8a-eb87ede52d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:12Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Creating volume f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:12 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfd4d7f-1adc-4216-8191-8638d0a4a845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:12 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 1073741824 Nov 02 10:21:12 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9f6021-2165-48bf-b98f-cb6aafa0f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:12 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Volume volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd (7e25a69d-db92-4010-ad7e-5ff03c12e2fd): created successfully Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9f6021-2165-48bf-b98f-cb6aafa0f947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (2aeb3c54-61ff-40fc-921d-d606f74f2afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:12 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d17d12fa-0416-409d-bffc-ebd813523400 tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:21:12 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 1073741824" returned: 0 in 0.428s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:12 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:12 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 Nov 02 10:21:12 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:13 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16" returned: 0 in 0.231s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f213eb-e0f3-4644-857f-2971201c1feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50ff999-98fa-4519-bd8a-eb87ede52d16', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b8c3bc-63da-4581-bf31-cfc4b4b0a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:13 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Volume volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 (f50ff999-98fa-4519-bd8a-eb87ede52d16): created successfully Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b8c3bc-63da-4581-bf31-cfc4b4b0a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (6388acf8-55e2-4e1c-99ef-7106975361af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:13 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-a27478ee-6bce-4b6c-9883-e2ff37c9b877 tempest-ProjectReaderTests-191276047 None] Created volume successfully. Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 3699490f-538c-475e-995a-6e640b2ed871 of volume 7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8800b2ea-9abb-4b0b-8996-56ce3f7de70d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:13 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:13 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd Nov 02 10:21:13 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:14 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" returned: 0 in 0.374s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:14 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 1G Nov 02 10:21:14 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:14 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 1G" returned: 0 in 0.444s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:14 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 Nov 02 10:21:14 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:14 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871" returned: 0 in 0.289s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:14 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 is being set with open permissions: ugo+rw Nov 02 10:21:14 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:14 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 Nov 02 10:21:14 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:15 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871" returned: 0 in 0.239s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:15 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.info Nov 02 10:21:15 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:15 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.info" returned: 0 in 0.261s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:15 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.info is being set with open permissions: ugo+rw Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:15 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.info Nov 02 10:21:15 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:15 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.info" returned: 0 in 0.243s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.314s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Creating offline snapshot 3ba671b5-e394-49f9-a0c5-e124ee56fd3c of volume f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:15 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-539c13ac-08e9-4267-b239-d581a6eea3dc tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9651a408-7934-40f5-9406-c8d97d81f07b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:15 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 Nov 02 10:21:15 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-3699490f-538c-475e-995a-6e640b2ed871-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-3699490f-538c-475e-995a-6e640b2ed871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-3699490f-538c-475e-995a-6e640b2ed871" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-3699490f-538c-475e-995a-6e640b2ed871" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 3699490f-538c-475e-995a-6e640b2ed871 of volume 7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:15 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a1a69-6d30-4b38-a4ef-7c73c175187e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:16 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 Nov 02 10:21:16 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:16 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16" returned: 0 in 0.405s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:16 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c 1G Nov 02 10:21:16 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:16 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871" returned: 0 in 0.380s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa5a739-ec24-46a7-b0c7-33a6c3295d4e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:16 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd Nov 02 10:21:16 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:16 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c 1G" returned: 0 in 0.433s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:16 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c Nov 02 10:21:16 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:16 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" returned: 0 in 0.384s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:16 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 Nov 02 10:21:16 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:16 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c" returned: 0 in 0.327s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:16 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c is being set with open permissions: ugo+rw Nov 02 10:21:16 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:16 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c Nov 02 10:21:16 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:17 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871" returned: 0 in 0.354s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:17 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871 Nov 02 10:21:17 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:17 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c" returned: 0 in 0.281s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:17 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.info Nov 02 10:21:17 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:17 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd.3699490f-538c-475e-995a-6e640b2ed871" returned: 0 in 0.258s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-3699490f-538c-475e-995a-6e640b2ed871" released by "_delete_snapshot" :: held 1.483s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" released by "delete_snapshot" :: held 1.510s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:17 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.info" returned: 0 in 0.292s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:17 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.info is being set with open permissions: ugo+rw Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Created reservations ['073295c3-f657-4e38-9cc9-6ce5ecb3cf03', 'b8b92c02-175e-4dc7-8023-f2f43d4106d7', '095b26ad-9730-4e76-b223-6f7d9a2ff861', '4dc83c10-7451-459c-a36f-b85ff3e09913'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:17 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.info Nov 02 10:21:17 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:17 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-12a36bb9-9003-47ac-9872-ff045e2fd7c4 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-3699490f-538c-475e-995a-6e640b2ed871-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:17 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.info" returned: 0 in 0.255s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:17 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:17 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9bb703a3-4f78-4104-bcbf-dc07e56510fe tempest-ProjectReaderTests-191276047 None] Create snapshot completed successfully Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-7e25a69d-db92-4010-ad7e-5ff03c12e2fd-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-7e25a69d-db92-4010-ad7e-5ff03c12e2fd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a8e8a-32af-4310-bd9f-c02fffb44eea]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:18 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd Nov 02 10:21:18 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:18 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" returned: 0 in 0.376s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:18 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd Nov 02 10:21:18 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-3ba671b5-e394-49f9-a0c5-e124ee56fd3c-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Lock "cinder-3ba671b5-e394-49f9-a0c5-e124ee56fd3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-f50ff999-98fa-4519-bd8a-eb87ede52d16" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-f50ff999-98fa-4519-bd8a-eb87ede52d16" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-3ba671b5-e394-49f9-a0c5-e124ee56fd3c" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-3ba671b5-e394-49f9-a0c5-e124ee56fd3c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Deleting offline snapshot 3ba671b5-e394-49f9-a0c5-e124ee56fd3c of volume f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:18 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] snapshot_file for this snap is: volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" returned: 0 in 0.281s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f09621f-1a5a-48dd-b725-411e2a7b972b]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-7e25a69d-db92-4010-ad7e-5ff03c12e2fd" released by "delete_volume" :: held 0.727s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Created reservations ['9b022e18-6cb2-4172-9f28-d96256e39108', 'd1c4c157-ed78-4336-a42a-851b44ce9eba', '4899bad9-bfc5-471e-817d-71b963af45c8', '3e03697f-b773-4dbc-9cd5-9e25fcfa70a6'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:18 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c Nov 02 10:21:18 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:18 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:19 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:19 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:19 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c" returned: 0 in 0.407s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50ff999-98fa-4519-bd8a-eb87ede52d16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:19 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.290s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:19 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c6cda8-aba3-4959-90f9-4c9046865398]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d6df77a1-547c-4994-b0b8-a2faa64b0ef1 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-7e25a69d-db92-4010-ad7e-5ff03c12e2fd-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:19 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 Nov 02 10:21:19 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:19 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16" returned: 0 in 0.406s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:19 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c Nov 02 10:21:19 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (1298057e-8d2a-4ab3-b3c3-1fc6ab0cfa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df544fc7-05c1-42a1-b20a-f4b2be7051ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df544fc7-05c1-42a1-b20a-f4b2be7051ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439871126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4514b8ad-9602-4b41-bbb5-f40f8433ccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:20Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b923ab1-48b8-4bd5-be7e-a52f4a95af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b923ab1-48b8-4bd5-be7e-a52f4a95af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d721eb-8e0d-4e1c-bd1a-aa6e60c2103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d721eb-8e0d-4e1c-bd1a-aa6e60c2103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4514b8ad-9602-4b41-bbb5-f40f8433ccb8', 'volume_name': 'volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fd3094-f973-4acd-9e17-339c2f2aca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fd3094-f973-4acd-9e17-339c2f2aca37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9705cec-866b-4559-a476-16b463879b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:19 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Volume 4514b8ad-9602-4b41-bbb5-f40f8433ccb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8', 'volume_size': 1} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439871126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4514b8ad-9602-4b41-bbb5-f40f8433ccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:20Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Creating volume 4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:19 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:19 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:19 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 1073741824 Nov 02 10:21:19 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c" returned: 0 in 0.348s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:20 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c Nov 02 10:21:20 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 1073741824" returned: 0 in 0.457s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16.3ba671b5-e394-49f9-a0c5-e124ee56fd3c" returned: 0 in 0.259s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-3ba671b5-e394-49f9-a0c5-e124ee56fd3c" released by "_delete_snapshot" :: held 1.542s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-f50ff999-98fa-4519-bd8a-eb87ede52d16" released by "delete_snapshot" :: held 1.564s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:20 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 Nov 02 10:21:20 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Created reservations ['cd1a57ee-926d-4b92-bb47-67a1a61b21ef', 'f1cf4251-08df-41b9-a5e9-21f4abdcd779', 'b0696800-cfd6-49ca-adf4-f641ba273afc', '095d4ac6-b3d8-4d15-86e3-ec5c5f5b7fc9'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Delete snapshot completed successfully. Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4785e77c-157f-4a75-981f-3b7bdabfc37c tempest-ProjectReaderTests-191276047 None] Lock "cinder-3ba671b5-e394-49f9-a0c5-e124ee56fd3c-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:20 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" returned: 0 in 0.269s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9705cec-866b-4559-a476-16b463879b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a947bf8e-91f9-4d77-9310-3dba657ae8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:20 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Volume volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 (4514b8ad-9602-4b41-bbb5-f40f8433ccb8): created successfully Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a947bf8e-91f9-4d77-9310-3dba657ae8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (1298057e-8d2a-4ab3-b3c3-1fc6ab0cfa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:20 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ab01434f-ceb7-4552-baa2-ae95e6e059a7 tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-f50ff999-98fa-4519-bd8a-eb87ede52d16-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Lock "cinder-f50ff999-98fa-4519-bd8a-eb87ede52d16-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-f50ff999-98fa-4519-bd8a-eb87ede52d16" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:20 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-f50ff999-98fa-4519-bd8a-eb87ede52d16" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6faa3c-18b2-40e3-82d1-1392fcdc324f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:21 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 Nov 02 10:21:21 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:21 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16" returned: 0 in 0.386s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:21 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16 Nov 02 10:21:21 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:21 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f50ff999-98fa-4519-bd8a-eb87ede52d16" returned: 0 in 0.248s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-f50ff999-98fa-4519-bd8a-eb87ede52d16" released by "delete_volume" :: held 0.697s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Created reservations ['36315162-0bff-4a0e-8cfd-cc3d4e8ca671', '99654895-4095-45a1-838f-a79f6c3ece32', '3368fdb9-ad03-49df-b83d-2b5bc61c3a00', '0cd5bf70-0b85-4af7-a466-b3c317a35ba2'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:21 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:21 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:21 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 77c97fb7-d839-4455-b473-82cb1f9023e1 of volume 4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b7d685-a82e-4c5f-ba1e-b0da79fec497]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:22 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.274s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:22 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Deleted volume successfully. Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9389bc7e-014f-4a64-b54a-28495bd5df5c tempest-ProjectReaderTests-191276047 None] Lock "cinder-f50ff999-98fa-4519-bd8a-eb87ede52d16-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:22 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 Nov 02 10:21:22 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:22 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" returned: 0 in 0.388s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:22 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 1G Nov 02 10:21:22 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (7f9f9016-6e91-4c47-8a22-c5dddad2eab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae1d71b-a5a9-44f2-a73b-83e8ae406bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae1d71b-a5a9-44f2-a73b-83e8ae406bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895733949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1127b45c-30da-49b6-ade7-54c9ffd7694f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:23Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3e71af-bbdc-4200-b834-aa3a3b742f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3e71af-bbdc-4200-b834-aa3a3b742f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa140a62-131d-4fa8-9521-1acfb1d2643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa140a62-131d-4fa8-9521-1acfb1d2643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1127b45c-30da-49b6-ade7-54c9ffd7694f', 'volume_name': 'volume-1127b45c-30da-49b6-ade7-54c9ffd7694f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449d228e-8775-45ce-8f3c-4ba4adf4b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449d228e-8775-45ce-8f3c-4ba4adf4b163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148cee0d-e454-44e7-8278-ddae1ead12f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:22 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Volume 1127b45c-30da-49b6-ade7-54c9ffd7694f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1127b45c-30da-49b6-ade7-54c9ffd7694f', 'volume_size': 1} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:22 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 1G" returned: 0 in 0.403s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:22 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:22 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 Nov 02 10:21:22 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:23 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1" returned: 0 in 0.292s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:23 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 is being set with open permissions: ugo+rw Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:23 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 Nov 02 10:21:23 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:23 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1" returned: 0 in 0.242s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:23 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.info Nov 02 10:21:23 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:23 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.info" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:23 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.info is being set with open permissions: ugo+rw Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:23 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.info Nov 02 10:21:23 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:23 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.info" returned: 0 in 0.248s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895733949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1127b45c-30da-49b6-ade7-54c9ffd7694f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:23Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Creating volume 1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:23 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:23 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:23 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f 1073741824 Nov 02 10:21:23 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-8c9694bd-c596-434b-9228-bba78ab1a802 tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-77c97fb7-d839-4455-b473-82cb1f9023e1-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-77c97fb7-d839-4455-b473-82cb1f9023e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-77c97fb7-d839-4455-b473-82cb1f9023e1" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-77c97fb7-d839-4455-b473-82cb1f9023e1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 77c97fb7-d839-4455-b473-82cb1f9023e1 of volume 4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd3bd1-99b9-4d11-8051-93ea01e7364f]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:24 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 Nov 02 10:21:24 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:24 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f 1073741824" returned: 0 in 0.474s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:24 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f Nov 02 10:21:24 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:24 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1" returned: 0 in 0.389s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8dbbf0-f2be-4703-9374-d67933776196]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:24 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148cee0d-e454-44e7-8278-ddae1ead12f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1127b45c-30da-49b6-ade7-54c9ffd7694f', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd0e9cb-c05e-4562-a89a-68506e8edb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:24 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Volume volume-1127b45c-30da-49b6-ade7-54c9ffd7694f (1127b45c-30da-49b6-ade7-54c9ffd7694f): created successfully Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd0e9cb-c05e-4562-a89a-68506e8edb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:24 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (7f9f9016-6e91-4c47-8a22-c5dddad2eab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:24 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-0937d08a-ee6e-4472-93f3-d9e5298610c9 tempest-ProjectReaderTests-191276047 None] Created volume successfully. Nov 02 10:21:24 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 Nov 02 10:21:24 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:25 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" returned: 0 in 0.366s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:25 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 Nov 02 10:21:25 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:25 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1" returned: 0 in 0.334s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:25 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1 Nov 02 10:21:25 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:25 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8.77c97fb7-d839-4455-b473-82cb1f9023e1" returned: 0 in 0.246s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-77c97fb7-d839-4455-b473-82cb1f9023e1" released by "_delete_snapshot" :: held 1.444s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" released by "delete_snapshot" :: held 1.466s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Created reservations ['da5052c6-505c-45c9-8e40-a83397d85ef2', '1495db81-1418-45c1-bc59-830c5b44faa2', '6a868e07-f590-4a28-9382-81a76c6cb502', '64cfe625-2e9f-4cad-a9e8-7d159f33d90a'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:25 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-25f74453-2a59-446d-a5b9-0bef3dc5e840 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-77c97fb7-d839-4455-b473-82cb1f9023e1-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Creating offline snapshot 7020b670-f5e8-4130-ac86-aea6ea4d2552 of volume 1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e28df6c-c5e9-4de9-bbaa-587e3993f4ed]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:25 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:25 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f Nov 02 10:21:25 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:26 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f" returned: 0 in 0.356s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:26 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 1G Nov 02 10:21:26 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-4514b8ad-9602-4b41-bbb5-f40f8433ccb8-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-4514b8ad-9602-4b41-bbb5-f40f8433ccb8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[363aa2af-2111-4c1d-a2a5-b0a9a685cb65]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:26 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 Nov 02 10:21:26 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:26 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 1G" returned: 0 in 0.410s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1127b45c-30da-49b6-ade7-54c9ffd7694f -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:26 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1127b45c-30da-49b6-ade7-54c9ffd7694f -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 Nov 02 10:21:26 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:26 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" returned: 0 in 0.379s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:26 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8 Nov 02 10:21:26 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:26 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1127b45c-30da-49b6-ade7-54c9ffd7694f -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552" returned: 0 in 0.290s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:26 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 is being set with open permissions: ugo+rw Nov 02 10:21:26 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:26 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 Nov 02 10:21:26 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-4514b8ad-9602-4b41-bbb5-f40f8433ccb8" released by "delete_volume" :: held 0.697s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Created reservations ['4543dfdd-8d70-4ce7-811d-72e4f1f31b5f', 'a497f8a8-f9de-4f28-8244-9ba3165ab303', '7d41538c-776e-4c4a-a662-781fe00bd989', '6bb137dc-4498-4c8c-93ab-452ca4be97cc'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:27 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.info Nov 02 10:21:27 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:27 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.info" returned: 0 in 0.279s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.info is being set with open permissions: ugo+rw Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.info Nov 02 10:21:27 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.287s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-e666ff82-e920-4992-afc0-6f06cbcb1337 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-4514b8ad-9602-4b41-bbb5-f40f8433ccb8-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:27 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.info" returned: 0 in 0.259s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:27 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-18470bfe-73d6-4b9a-8a1d-28db47d02c1a tempest-ProjectReaderTests-191276047 None] Create snapshot completed successfully Nov 02 10:21:27 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-7020b670-f5e8-4130-ac86-aea6ea4d2552-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Lock "cinder-7020b670-f5e8-4130-ac86-aea6ea4d2552-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-1127b45c-30da-49b6-ade7-54c9ffd7694f" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (45adfb8f-0c60-4f9b-b5b7-b4ad0b7f2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4431fb2-59fe-4115-a800-2d9add6f548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4431fb2-59fe-4115-a800-2d9add6f548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-190804043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42afcfcf-7c77-4aca-9f48-6981d6d8d6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:28Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c042a4-32a5-4750-b0d7-105c5b44d30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c042a4-32a5-4750-b0d7-105c5b44d30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea7f244-3389-4408-bafa-5f6f1d7992ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea7f244-3389-4408-bafa-5f6f1d7992ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42afcfcf-7c77-4aca-9f48-6981d6d8d6d3', 'volume_name': 'volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b116cedf-fed1-42b5-8492-2d114c50087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b116cedf-fed1-42b5-8492-2d114c50087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4f8e8f-6d5a-44e3-a405-2158138bdbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:28 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Volume 42afcfcf-7c77-4aca-9f48-6981d6d8d6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3', 'volume_size': 1} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-190804043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42afcfcf-7c77-4aca-9f48-6981d6d8d6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:28Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Creating volume 42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:28 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-1127b45c-30da-49b6-ade7-54c9ffd7694f" acquired by "delete_snapshot" :: waited 0.107s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-7020b670-f5e8-4130-ac86-aea6ea4d2552" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:28 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 1073741824 Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-7020b670-f5e8-4130-ac86-aea6ea4d2552" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:28 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Deleting offline snapshot 7020b670-f5e8-4130-ac86-aea6ea4d2552 of volume 1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] snapshot_file for this snap is: volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05d6da-8600-4e08-b3d5-9a87c52f860c]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:28 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 Nov 02 10:21:28 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:28 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552" returned: 0 in 0.397s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1127b45c-30da-49b6-ade7-54c9ffd7694f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2776392-936e-4198-b569-02d936d3786d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:28 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 1073741824" returned: 0 in 0.503s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:28 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 Nov 02 10:21:28 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:28 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f Nov 02 10:21:28 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:28 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" returned: 0 in 0.264s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4f8e8f-6d5a-44e3-a405-2158138bdbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d1a03f-db07-4668-a8c5-8c860435fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:28 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Volume volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 (42afcfcf-7c77-4aca-9f48-6981d6d8d6d3): created successfully Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d1a03f-db07-4668-a8c5-8c860435fccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (45adfb8f-0c60-4f9b-b5b7-b4ad0b7f2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:28 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-18d6f6df-b3a5-424d-8d73-3e045befcc43 tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:21:29 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f" returned: 0 in 0.398s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:29 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 Nov 02 10:21:29 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:29 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552" returned: 0 in 0.321s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:29 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552 Nov 02 10:21:29 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:29 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f.7020b670-f5e8-4130-ac86-aea6ea4d2552" returned: 0 in 0.236s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-7020b670-f5e8-4130-ac86-aea6ea4d2552" released by "_delete_snapshot" :: held 1.453s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-1127b45c-30da-49b6-ade7-54c9ffd7694f" released by "delete_snapshot" :: held 1.478s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Created reservations ['ac19e8a2-7bd6-4eec-b635-a1f96e900e1e', 'd11b3d0f-57e7-4cc5-8a5b-5971101b53dc', '14265315-6554-4398-9719-0797abe6b155', '2b450418-092a-43ec-bffd-65316911f481'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:29 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Delete snapshot completed successfully. Nov 02 10:21:29 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-d91ad5fc-a8a6-4e71-ba4e-d4b458ca8313 tempest-ProjectReaderTests-191276047 None] Lock "cinder-7020b670-f5e8-4130-ac86-aea6ea4d2552-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-1127b45c-30da-49b6-ade7-54c9ffd7694f-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Lock "cinder-1127b45c-30da-49b6-ade7-54c9ffd7694f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 708599d5-e1de-43c3-8edc-a1bf15aacced of volume 42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-1127b45c-30da-49b6-ade7-54c9ffd7694f" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be3effb-80e8-47eb-ba11-35288e973d22]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-1127b45c-30da-49b6-ade7-54c9ffd7694f" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3795d4-dc03-4965-983d-82a7202e2896]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:30 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 Nov 02 10:21:30 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:30 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f Nov 02 10:21:30 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:30 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" returned: 0 in 0.376s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:30 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced 1G Nov 02 10:21:30 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:30 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f" returned: 0 in 0.353s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:30 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f Nov 02 10:21:30 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:30 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-1127b45c-30da-49b6-ade7-54c9ffd7694f" returned: 0 in 0.246s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:30 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-1127b45c-30da-49b6-ade7-54c9ffd7694f" released by "delete_volume" :: held 0.666s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Created reservations ['90f1503a-a3f1-49a4-abef-35d9351bc72f', 'fede1f45-3242-485a-9284-9113ea97113e', '47794d56-503c-4695-9082-7beeb7584a79', '38dacab7-2dc4-4a62-9942-975641792b11'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:31 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced 1G" returned: 0 in 0.417s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:31 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced Nov 02 10:21:31 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:31 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:31 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:31 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced" returned: 0 in 0.341s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:31 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced is being set with open permissions: ugo+rw Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:31 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.278s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:31 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Deleted volume successfully. Nov 02 10:21:31 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced Nov 02 10:21:31 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-61e98fbd-5eec-4c12-a4dc-ecd9b59d90c2 tempest-ProjectReaderTests-191276047 None] Lock "cinder-1127b45c-30da-49b6-ade7-54c9ffd7694f-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:31 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced" returned: 0 in 0.258s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:31 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.info Nov 02 10:21:31 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (510e2b43-320b-41e4-a1c1-5aa9e35f1854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44878e45-fc9d-4b40-8b7c-31010ac08156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44878e45-fc9d-4b40-8b7c-31010ac08156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244682913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec61dea-f4df-497f-9847-73d91a174c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:32Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f802cc35-61e4-47b9-af83-2363cf56c582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f802cc35-61e4-47b9-af83-2363cf56c582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c897f7be-65c5-4bd7-835c-07737a93abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c897f7be-65c5-4bd7-835c-07737a93abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dec61dea-f4df-497f-9847-73d91a174c59', 'volume_name': 'volume-dec61dea-f4df-497f-9847-73d91a174c59', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd8b72d-526d-4a62-820b-ddd1a0b440ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd8b72d-526d-4a62-820b-ddd1a0b440ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f79a1a0-d173-4361-9e5f-696f6950fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:31 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Volume dec61dea-f4df-497f-9847-73d91a174c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dec61dea-f4df-497f-9847-73d91a174c59', 'volume_size': 1} Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:31 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.info" returned: 0 in 0.260s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:31 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.info is being set with open permissions: ugo+rw Nov 02 10:21:31 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:32 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.info Nov 02 10:21:32 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:32 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.info" returned: 0 in 0.250s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244682913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec61dea-f4df-497f-9847-73d91a174c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:32Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Creating volume dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:32 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:32 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 1073741824 Nov 02 10:21:32 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:32 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-1c2b1429-3035-4766-8537-a5bde880c02a tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:21:32 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 1073741824" returned: 0 in 0.415s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:32 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 Nov 02 10:21:32 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:32 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59" returned: 0 in 0.249s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f79a1a0-d173-4361-9e5f-696f6950fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec61dea-f4df-497f-9847-73d91a174c59', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:32 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82de3b01-ab6d-4eeb-91a6-2ae426005c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:32 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Volume volume-dec61dea-f4df-497f-9847-73d91a174c59 (dec61dea-f4df-497f-9847-73d91a174c59): created successfully Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82de3b01-ab6d-4eeb-91a6-2ae426005c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (510e2b43-320b-41e4-a1c1-5aa9e35f1854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:33 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d39f8c36-a32a-4883-9300-93820c84b466 tempest-ProjectReaderTests-191276047 None] Created volume successfully. Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-708599d5-e1de-43c3-8edc-a1bf15aacced-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-708599d5-e1de-43c3-8edc-a1bf15aacced-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-708599d5-e1de-43c3-8edc-a1bf15aacced" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-708599d5-e1de-43c3-8edc-a1bf15aacced" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 708599d5-e1de-43c3-8edc-a1bf15aacced of volume 42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b0df3-f8ce-42ab-b49b-5356ab05d0d7]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:33 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced Nov 02 10:21:33 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:33 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced" returned: 0 in 0.424s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca3b826-61fe-48e9-a025-40e0dc68b3e9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:33 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:34 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 Nov 02 10:21:34 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Creating offline snapshot 5cdd5a26-57de-4aea-8cec-6830176a3e37 of volume dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0146ad80-9078-4218-a288-fe931fe90e24]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:34 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 Nov 02 10:21:34 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:34 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" returned: 0 in 0.441s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:34 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced Nov 02 10:21:34 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:34 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59" returned: 0 in 0.428s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:34 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 1G Nov 02 10:21:34 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:34 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced" returned: 0 in 0.347s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:34 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:34 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced Nov 02 10:21:34 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3.708599d5-e1de-43c3-8edc-a1bf15aacced" returned: 0 in 0.259s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 1G" returned: 0 in 0.430s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec61dea-f4df-497f-9847-73d91a174c59 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-708599d5-e1de-43c3-8edc-a1bf15aacced" released by "_delete_snapshot" :: held 1.600s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" released by "delete_snapshot" :: held 1.627s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:35 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec61dea-f4df-497f-9847-73d91a174c59 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 Nov 02 10:21:35 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Created reservations ['aa52e2a0-ba8f-43e7-a315-1aca079d0442', '21d47228-3c54-4e51-a389-64c04f1c2969', '503cefb7-32f1-4f60-a04f-129aebdccf65', '91307a2e-46ff-4ad4-9adb-1bcc1c4e9e9e'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:35 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4dc3ee34-e85c-4899-abbf-76a3935ef366 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-708599d5-e1de-43c3-8edc-a1bf15aacced-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:35 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec61dea-f4df-497f-9847-73d91a174c59 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37" returned: 0 in 0.300s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 is being set with open permissions: ugo+rw Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:35 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 Nov 02 10:21:35 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:35 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37" returned: 0 in 0.268s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:35 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.info Nov 02 10:21:35 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd4094-524a-440b-a6b1-c121a2e6f595]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:35 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 Nov 02 10:21:35 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.info" returned: 0 in 0.262s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.info is being set with open permissions: ugo+rw Nov 02 10:21:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:35 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.info Nov 02 10:21:35 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:36 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" returned: 0 in 0.397s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:36 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:36 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3 Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.info" returned: 0 in 0.259s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:36 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-d37416cd-d648-4c5f-ab3f-a5c14c26b678 tempest-ProjectReaderTests-191276047 None] Create snapshot completed successfully Nov 02 10:21:36 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3" released by "delete_volume" :: held 0.722s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Created reservations ['e9ef2d49-fb62-442d-8550-b26e7ef64427', '36db7348-85cf-42dc-b215-9a92f86dbc4c', '0e542c64-c39f-467e-a772-c93baab2f07c', 'b00bec0c-2cfc-4316-8c5c-289fb12f96c3'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:36 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:36 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:36 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.240s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:21:36 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ade2b5ff-8cf3-4cca-b9cc-cfde47fee88f tempest-ProjectMemberTests-2033426512 None] Lock "cinder-42afcfcf-7c77-4aca-9f48-6981d6d8d6d3-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (4ece88de-0ee5-4967-8de2-c8df52fd9b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222294ac-9aaa-4598-91e8-ad69069d0dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222294ac-9aaa-4598-91e8-ad69069d0dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355057013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68766de8-4b0f-42be-b9aa-27c30c6cf496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:37Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4eef85-6769-4c48-8d4c-be2b8ccaace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4eef85-6769-4c48-8d4c-be2b8ccaace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e006fc-19fd-411d-adb9-9787c9547a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e006fc-19fd-411d-adb9-9787c9547a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68766de8-4b0f-42be-b9aa-27c30c6cf496', 'volume_name': 'volume-68766de8-4b0f-42be-b9aa-27c30c6cf496', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82374ed9-c1a3-41a6-801b-8cc17066186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82374ed9-c1a3-41a6-801b-8cc17066186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a0c625-3d30-4ac4-832d-9d89138bb2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Volume 68766de8-4b0f-42be-b9aa-27c30c6cf496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68766de8-4b0f-42be-b9aa-27c30c6cf496', 'volume_size': 1} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355057013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68766de8-4b0f-42be-b9aa-27c30c6cf496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251811a7e1d4e3db5449561f5328897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:37Z,use_quota=True,user_id='662132a7a1d94f5ab03abc4f29fc5ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Creating volume 68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:37 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-5cdd5a26-57de-4aea-8cec-6830176a3e37-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:37 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 1073741824 Nov 02 10:21:37 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Lock "cinder-5cdd5a26-57de-4aea-8cec-6830176a3e37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-dec61dea-f4df-497f-9847-73d91a174c59" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-dec61dea-f4df-497f-9847-73d91a174c59" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-5cdd5a26-57de-4aea-8cec-6830176a3e37" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-5cdd5a26-57de-4aea-8cec-6830176a3e37" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Deleting offline snapshot 5cdd5a26-57de-4aea-8cec-6830176a3e37 of volume dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] snapshot_file for this snap is: volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[800745b9-9221-4243-af31-faa471d25598]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:37 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 Nov 02 10:21:37 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:37 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 1073741824" returned: 0 in 0.447s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:37 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 Nov 02 10:21:37 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:37 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37" returned: 0 in 0.418s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dec61dea-f4df-497f-9847-73d91a174c59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054b818-8b68-4c12-930e-eabd02a5ccff]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:38 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 Nov 02 10:21:38 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:38 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a0c625-3d30-4ac4-832d-9d89138bb2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68766de8-4b0f-42be-b9aa-27c30c6cf496', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bc463-e159-442c-b31a-c0c9b8793e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:38 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Volume volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 (68766de8-4b0f-42be-b9aa-27c30c6cf496): created successfully Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bc463-e159-442c-b31a-c0c9b8793e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Flow 'volume_create_manager' (4ece88de-0ee5-4967-8de2-c8df52fd9b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:38 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b170927c-7bf9-4bb4-9231-3b15fda7a9af tempest-ProjectMemberTests-2033426512 None] Created volume successfully. Nov 02 10:21:38 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59" returned: 0 in 0.390s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:38 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 Nov 02 10:21:38 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Creating offline snapshot 666a183e-956b-4ebc-95e1-884c7929e4be of volume 68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20450f7-109a-486c-a26f-66625152301e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:38 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 Nov 02 10:21:38 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:38 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37" returned: 0 in 0.414s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:38 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37 Nov 02 10:21:38 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:38 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496" returned: 0 in 0.366s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:38 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be 1G Nov 02 10:21:38 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:39 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59.5cdd5a26-57de-4aea-8cec-6830176a3e37" returned: 0 in 0.279s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-5cdd5a26-57de-4aea-8cec-6830176a3e37" released by "_delete_snapshot" :: held 1.618s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-dec61dea-f4df-497f-9847-73d91a174c59" released by "delete_snapshot" :: held 1.645s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Created reservations ['5dc87c94-c441-426b-abe8-c689ff4913a2', '029cf38f-e804-4b56-8727-8b30d12627f3', '9ffc5c9d-011d-4920-a9ad-0c631cd05396', '0ce99fad-1f17-4b76-8723-eb51ce86c520'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:39 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Delete snapshot completed successfully. Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-ba930b4c-ed00-44ad-a48b-ded0b11b32c6 tempest-ProjectReaderTests-191276047 None] Lock "cinder-5cdd5a26-57de-4aea-8cec-6830176a3e37-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:39 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be 1G" returned: 0 in 0.435s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:39 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be Nov 02 10:21:39 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-dec61dea-f4df-497f-9847-73d91a174c59-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Lock "cinder-dec61dea-f4df-497f-9847-73d91a174c59-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-dec61dea-f4df-497f-9847-73d91a174c59" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-dec61dea-f4df-497f-9847-73d91a174c59" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:39 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be" returned: 0 in 0.339s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:39 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be is being set with open permissions: ugo+rw Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7571ed7-152d-4c37-9f45-113d3e095dcc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:39 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be Nov 02 10:21:39 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:39 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 Nov 02 10:21:39 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:39 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be" returned: 0 in 0.276s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:40 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.info Nov 02 10:21:40 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:40 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59" returned: 0 in 0.388s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:40 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59 Nov 02 10:21:40 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:40 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.info" returned: 0 in 0.266s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.info is being set with open permissions: ugo+rw Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:40 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.info Nov 02 10:21:40 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:40 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-dec61dea-f4df-497f-9847-73d91a174c59" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-dec61dea-f4df-497f-9847-73d91a174c59" released by "delete_volume" :: held 0.714s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Created reservations ['f7a0a5ce-1491-4946-9c44-e480415466ba', '8d691ba1-e4e1-4015-ab33-f1c4ed194345', '29a57828-a30f-400e-b018-9745fadadc69', 'f17900c8-6988-4d3d-b7be-31c6fb7424e8'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:40 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:40 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:40 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.info" returned: 0 in 0.277s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:40 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-493e1058-64ea-428f-aefb-5d7bdb271ef9 tempest-ProjectMemberTests-2033426512 None] Create snapshot completed successfully Nov 02 10:21:40 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.263s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:40 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Deleted volume successfully. Nov 02 10:21:40 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-af32553c-8c6a-4c89-89f2-7e8fc7a4311b tempest-ProjectReaderTests-191276047 None] Lock "cinder-dec61dea-f4df-497f-9847-73d91a174c59-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (8320e716-bef9-4a11-a94f-3b210dadfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85eb24d-4160-4e88-bb96-4b46c00ec4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85eb24d-4160-4e88-bb96-4b46c00ec4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874973125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763f3217-a3a5-48b0-bc73-b074498b090c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:41Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e061a185-408f-4f56-b090-140234e67a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e061a185-408f-4f56-b090-140234e67a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baee289d-d8ff-46e6-a851-164a065c5ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baee289d-d8ff-46e6-a851-164a065c5ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763f3217-a3a5-48b0-bc73-b074498b090c', 'volume_name': 'volume-763f3217-a3a5-48b0-bc73-b074498b090c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bce5d07-fa81-423e-820f-69b8e47d9dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bce5d07-fa81-423e-820f-69b8e47d9dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081e23a4-8fb0-4420-8c5a-c0ac0d202bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:41 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Volume 763f3217-a3a5-48b0-bc73-b074498b090c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763f3217-a3a5-48b0-bc73-b074498b090c', 'volume_size': 1} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874973125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763f3217-a3a5-48b0-bc73-b074498b090c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:41Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Creating volume 763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:41 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:41 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c 1073741824 Nov 02 10:21:41 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:41 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-666a183e-956b-4ebc-95e1-884c7929e4be-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c 1073741824" returned: 0 in 0.479s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-666a183e-956b-4ebc-95e1-884c7929e4be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-68766de8-4b0f-42be-b9aa-27c30c6cf496" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-68766de8-4b0f-42be-b9aa-27c30c6cf496" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-666a183e-956b-4ebc-95e1-884c7929e4be" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:41 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c Nov 02 10:21:41 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-666a183e-956b-4ebc-95e1-884c7929e4be" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Deleting offline snapshot 666a183e-956b-4ebc-95e1-884c7929e4be of volume 68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] snapshot_file for this snap is: volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1a7b63-9c4d-445e-83d1-dd02fbb4ddbe]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:41 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:42 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be Nov 02 10:21:42 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:42 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c" returned: 0 in 0.258s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081e23a4-8fb0-4420-8c5a-c0ac0d202bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763f3217-a3a5-48b0-bc73-b074498b090c', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bb5c7a-e820-4e6c-a8da-d32008041793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Volume volume-763f3217-a3a5-48b0-bc73-b074498b090c (763f3217-a3a5-48b0-bc73-b074498b090c): created successfully Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bb5c7a-e820-4e6c-a8da-d32008041793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (8320e716-bef9-4a11-a94f-3b210dadfd05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:42 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cef8a5b9-bf66-4d7f-af51-8123c933a2db tempest-ProjectReaderTests-191276047 None] Created volume successfully. Nov 02 10:21:42 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be" returned: 0 in 0.367s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68766de8-4b0f-42be-b9aa-27c30c6cf496(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f55695a-9a8d-412d-870f-e88922b3fc65]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:42 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 Nov 02 10:21:42 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:42 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496" returned: 0 in 0.340s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:42 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be Nov 02 10:21:42 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:42 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be" returned: 0 in 0.329s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:42 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:43 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be Nov 02 10:21:43 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:43 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496.666a183e-956b-4ebc-95e1-884c7929e4be" returned: 0 in 0.257s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-666a183e-956b-4ebc-95e1-884c7929e4be" released by "_delete_snapshot" :: held 1.400s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-68766de8-4b0f-42be-b9aa-27c30c6cf496" released by "delete_snapshot" :: held 1.427s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Created reservations ['7906c541-8af1-4174-bbae-20a0944b22d5', '60301e63-87bb-4209-b75e-3beb49ff9cd5', '9d62a2fc-2df3-4640-be08-375b9ace8eb1', 'bb7db4c6-b157-4ff6-877b-1d8042efcd50'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:43 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Delete snapshot completed successfully. Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-5eb05c9d-e0d9-47c7-bf79-45ef1d21bce9 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-666a183e-956b-4ebc-95e1-884c7929e4be-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Creating offline snapshot 70490339-fa8d-414c-bbad-529a9d8563f4 of volume 763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf9eb27-02a6-4cc0-954c-01ec1bc25546]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:43 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c Nov 02 10:21:43 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:43 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c" returned: 0 in 0.366s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:43 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 1G Nov 02 10:21:43 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-68766de8-4b0f-42be-b9aa-27c30c6cf496-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:43 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-68766de8-4b0f-42be-b9aa-27c30c6cf496-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "cinder-quobyte-68766de8-4b0f-42be-b9aa-27c30c6cf496" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-68766de8-4b0f-42be-b9aa-27c30c6cf496" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95241e4-aa39-49c4-8338-925ee4344faa]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:44 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 Nov 02 10:21:44 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:44 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 1G" returned: 0 in 0.460s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763f3217-a3a5-48b0-bc73-b074498b090c -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:44 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763f3217-a3a5-48b0-bc73-b074498b090c -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 Nov 02 10:21:44 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:44 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496" returned: 0 in 0.453s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:44 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496 Nov 02 10:21:44 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:44 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763f3217-a3a5-48b0-bc73-b074498b090c -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4" returned: 0 in 0.336s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 is being set with open permissions: ugo+rw Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:44 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 Nov 02 10:21:44 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:44 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-68766de8-4b0f-42be-b9aa-27c30c6cf496" returned: 0 in 0.267s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-quobyte-68766de8-4b0f-42be-b9aa-27c30c6cf496" released by "delete_volume" :: held 0.805s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Created reservations ['bfdd192f-af7e-41d9-a8bf-044e41cbadc2', '03dd999e-ac69-4572-a5fc-1994a034d661', 'e9099771-8499-4884-8b37-f7d4f694090c', '188f4c5a-a829-436e-9c98-f2d797f2a2ad'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:44 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4" returned: 0 in 0.259s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:45 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.info Nov 02 10:21:45 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:45 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:45 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:45 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.info" returned: 0 in 0.270s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:45 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.info is being set with open permissions: ugo+rw Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:45 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.info Nov 02 10:21:45 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:45 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.323s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Deleted volume successfully. Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-f622a4fc-5adc-4e36-9753-039817a394f2 tempest-ProjectMemberTests-2033426512 None] Lock "cinder-68766de8-4b0f-42be-b9aa-27c30c6cf496-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:45 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.info" returned: 0 in 0.289s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:45 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:45 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-b73355bd-5194-4ad4-8209-89a8f00bfc68 tempest-ProjectReaderTests-191276047 None] Create snapshot completed successfully Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-70490339-fa8d-414c-bbad-529a9d8563f4-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Lock "cinder-70490339-fa8d-414c-bbad-529a9d8563f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-763f3217-a3a5-48b0-bc73-b074498b090c" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-763f3217-a3a5-48b0-bc73-b074498b090c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-70490339-fa8d-414c-bbad-529a9d8563f4" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-70490339-fa8d-414c-bbad-529a9d8563f4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Deleting offline snapshot 70490339-fa8d-414c-bbad-529a9d8563f4 of volume 763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] snapshot_file for this snap is: volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7e6c73-ddf6-4eea-b28f-af043817aafb]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:46 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 Nov 02 10:21:46 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4" returned: 0 in 0.373s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-763f3217-a3a5-48b0-bc73-b074498b090c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d0bea-52de-407d-a9e0-e771d6ef653d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c Nov 02 10:21:47 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c" returned: 0 in 0.357s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 Nov 02 10:21:47 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4" returned: 0 in 0.382s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4 Nov 02 10:21:47 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:48 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c.70490339-fa8d-414c-bbad-529a9d8563f4" returned: 0 in 0.239s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-70490339-fa8d-414c-bbad-529a9d8563f4" released by "_delete_snapshot" :: held 1.457s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-763f3217-a3a5-48b0-bc73-b074498b090c" released by "delete_snapshot" :: held 1.477s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=252,cinder:SELECT=187,cinder:INSERT=66,cinder:DELETE=19 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=200,cinder:INSERT=76,cinder:UPDATE=240,cinder:DELETE=22 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Created reservations ['0e4ef3d9-98cc-4e21-beb1-202e75e5bce4', 'f052352d-8bcb-4972-bda1-624f86a83bbb', '9038ea36-0ca7-4ea2-bab4-cc7632b59f70', 'f104e16e-4670-4116-a9b0-cc5dbf91e90f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Delete snapshot completed successfully. Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-20d32cae-f387-4f12-ac2e-8c753169287d tempest-ProjectReaderTests-191276047 None] Lock "cinder-70490339-fa8d-414c-bbad-529a9d8563f4-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-763f3217-a3a5-48b0-bc73-b074498b090c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Lock "cinder-763f3217-a3a5-48b0-bc73-b074498b090c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:48 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:48 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-763f3217-a3a5-48b0-bc73-b074498b090c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-763f3217-a3a5-48b0-bc73-b074498b090c" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a006c6-769d-4b74-a1d5-60a424c0d82c]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:49 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c Nov 02 10:21:49 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.275s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:21:49 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c" returned: 0 in 0.365s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c Nov 02 10:21:49 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:49 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-763f3217-a3a5-48b0-bc73-b074498b090c" returned: 0 in 0.256s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-763f3217-a3a5-48b0-bc73-b074498b090c" released by "delete_volume" :: held 0.713s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Created reservations ['187dac05-f204-42e0-a773-9357b64088a8', '0b8a43ae-d875-4244-8350-6057a1d48d65', '9c972b87-a022-47d9-896b-679766a3d9cc', 'cb588411-05e9-460f-bc06-c3bd5166636f'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:49 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:50 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.260s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Deleted volume successfully. Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-11b6abc3-9650-4889-86d2-32f1a7174485 tempest-ProjectReaderTests-191276047 None] Lock "cinder-763f3217-a3a5-48b0-bc73-b074498b090c-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (9f1d6c9a-42af-4bc0-bdb6-9a933e101f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b67719d-148c-4e83-b76c-9deaeaee9ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b67719d-148c-4e83-b76c-9deaeaee9ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47481591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d63fb45-4b1d-4249-816d-a2e94777c607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:50Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5d4d78-9071-4992-ace0-f930f3a1f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5d4d78-9071-4992-ace0-f930f3a1f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da4ee4a-07fb-4d36-bfb2-a540de034c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da4ee4a-07fb-4d36-bfb2-a540de034c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d63fb45-4b1d-4249-816d-a2e94777c607', 'volume_name': 'volume-2d63fb45-4b1d-4249-816d-a2e94777c607', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce823f95-c67c-4126-af1b-d2971d8c44b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce823f95-c67c-4126-af1b-d2971d8c44b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402146b8-7cb7-4e06-9bf6-603050d806ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:50 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Volume 2d63fb45-4b1d-4249-816d-a2e94777c607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d63fb45-4b1d-4249-816d-a2e94777c607', 'volume_size': 1} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47481591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d63fb45-4b1d-4249-816d-a2e94777c607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c208988773046e980d75c226488959f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:50Z,use_quota=True,user_id='d6ae891288a144eaaff7dc98976ba71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Creating volume 2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:50 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:50 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 1073741824 Nov 02 10:21:50 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:51 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 1073741824" returned: 0 in 0.483s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:51 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 Nov 02 10:21:51 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:51 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607" returned: 0 in 0.242s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402146b8-7cb7-4e06-9bf6-603050d806ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d63fb45-4b1d-4249-816d-a2e94777c607', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa05fc4-6ee8-4868-a728-81cf4b7cc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:51 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Volume volume-2d63fb45-4b1d-4249-816d-a2e94777c607 (2d63fb45-4b1d-4249-816d-a2e94777c607): created successfully Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa05fc4-6ee8-4868-a728-81cf4b7cc301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:51 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Flow 'volume_create_manager' (9f1d6c9a-42af-4bc0-bdb6-9a933e101f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ff5b878e-c035-4f5b-97a7-3069491a1e39 tempest-ProjectReaderTests-191276047 None] Created volume successfully. Nov 02 10:21:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:52 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Creating offline snapshot dc2fccb9-466f-4c7c-abfc-a3151ce5832f of volume 2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:52 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1abbb-1618-47e9-b3e3-1a1ed8f08bcb]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:52 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:52 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 Nov 02 10:21:52 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:53 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607" returned: 0 in 0.371s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:53 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f 1G Nov 02 10:21:53 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:53 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f 1G" returned: 0 in 0.441s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d63fb45-4b1d-4249-816d-a2e94777c607 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:53 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d63fb45-4b1d-4249-816d-a2e94777c607 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f Nov 02 10:21:53 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:53 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d63fb45-4b1d-4249-816d-a2e94777c607 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f" returned: 0 in 0.317s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:53 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f is being set with open permissions: ugo+rw Nov 02 10:21:53 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:53 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f Nov 02 10:21:53 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:54 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f" returned: 0 in 0.267s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:54 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.info Nov 02 10:21:54 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:54 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.info" returned: 0 in 0.278s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:54 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.info is being set with open permissions: ugo+rw Nov 02 10:21:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:54 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.info Nov 02 10:21:54 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:54 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.info" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:54 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:54 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c1b834cc-0e4c-43f5-8808-34b422693c82 tempest-ProjectReaderTests-191276047 None] Create snapshot completed successfully Nov 02 10:21:55 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-dc2fccb9-466f-4c7c-abfc-a3151ce5832f-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Lock "cinder-dc2fccb9-466f-4c7c-abfc-a3151ce5832f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-2d63fb45-4b1d-4249-816d-a2e94777c607" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-2d63fb45-4b1d-4249-816d-a2e94777c607" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-dc2fccb9-466f-4c7c-abfc-a3151ce5832f" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-dc2fccb9-466f-4c7c-abfc-a3151ce5832f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Deleting offline snapshot dc2fccb9-466f-4c7c-abfc-a3151ce5832f of volume 2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] snapshot_file for this snap is: volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74e06fa-f536-45c7-b349-5798e207b2a6]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:56 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f Nov 02 10:21:56 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Flow 'volume_create_manager' (047b4ff1-3e1e-45e8-ae00-98f30d842436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179f4ff8-2fa6-40b3-88f6-b43de64351fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179f4ff8-2fa6-40b3-88f6-b43de64351fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808862369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7dbc69-619f-40d5-a9da-155c0114daf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ce72859146454685f70fcccb2fc9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:56Z,use_quota=True,user_id='717fb8c99c824e4582d1d9d67acaf628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538b4ef8-b3f5-42d7-9589-5ebd9393590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538b4ef8-b3f5-42d7-9589-5ebd9393590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c81e9f0-4ed6-403d-98d4-c011821d19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c81e9f0-4ed6-403d-98d4-c011821d19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7dbc69-619f-40d5-a9da-155c0114daf1', 'volume_name': 'volume-ad7dbc69-619f-40d5-a9da-155c0114daf1', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3e4a24-60d9-48b0-9d78-481eeecc9b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3e4a24-60d9-48b0-9d78-481eeecc9b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e956ba6-e829-47c6-842f-b7b3593e49a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:56 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Volume ad7dbc69-619f-40d5-a9da-155c0114daf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7dbc69-619f-40d5-a9da-155c0114daf1', 'volume_size': 1} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808862369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7dbc69-619f-40d5-a9da-155c0114daf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ce72859146454685f70fcccb2fc9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:56Z,use_quota=True,user_id='717fb8c99c824e4582d1d9d67acaf628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Creating volume ad7dbc69-619f-40d5-a9da-155c0114daf1 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:56 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:56 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:56 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 1073741824 Nov 02 10:21:56 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f" returned: 0 in 0.386s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d63fb45-4b1d-4249-816d-a2e94777c607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1541f-54f2-4ffe-9fe5-59d8508d7874]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:56 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 Nov 02 10:21:56 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:56 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 1073741824" returned: 0 in 0.435s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:56 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607" returned: 0 in 0.386s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:56 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f Nov 02 10:21:56 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:56 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:56 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 Nov 02 10:21:56 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:57 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1" returned: 0 in 0.250s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e956ba6-e829-47c6-842f-b7b3593e49a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7dbc69-619f-40d5-a9da-155c0114daf1', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b472883a-e698-4777-a438-f1972a46964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:57 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Volume volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 (ad7dbc69-619f-40d5-a9da-155c0114daf1): created successfully Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b472883a-e698-4777-a438-f1972a46964e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Flow 'volume_create_manager' (047b4ff1-3e1e-45e8-ae00-98f30d842436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-cca34d5d-6f09-4f77-8e55-3e4805c8f871 tempest-ProjectReaderTests-886906667 None] Created volume successfully. Nov 02 10:21:57 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f" returned: 0 in 0.366s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:57 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f Nov 02 10:21:57 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Acquiring lock "cinder-ad7dbc69-619f-40d5-a9da-155c0114daf1-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:57 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607.dc2fccb9-466f-4c7c-abfc-a3151ce5832f" returned: 0 in 0.256s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Lock "cinder-ad7dbc69-619f-40d5-a9da-155c0114daf1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-dc2fccb9-466f-4c7c-abfc-a3151ce5832f" released by "_delete_snapshot" :: held 1.536s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-2d63fb45-4b1d-4249-816d-a2e94777c607" released by "delete_snapshot" :: held 1.567s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Acquiring lock "cinder-quobyte-ad7dbc69-619f-40d5-a9da-155c0114daf1" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Lock "cinder-quobyte-ad7dbc69-619f-40d5-a9da-155c0114daf1" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec2a5d-2db2-42f4-b49b-c25a0cdcfa3e]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Created reservations ['510997f0-4994-4365-af37-0f2b85cfa8f5', '0872b27c-488f-4dae-be20-e044cafd97be', 'c022f680-277a-434c-af57-f1a95910cfe4', 'c2760570-9cc8-4a92-a3c7-cd6d7c8794b3'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:57 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Delete snapshot completed successfully. Nov 02 10:21:57 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-fb48ee58-aaa9-4b32-9444-ec36fefeb38f tempest-ProjectReaderTests-191276047 None] Lock "cinder-dc2fccb9-466f-4c7c-abfc-a3151ce5832f-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:57 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 Nov 02 10:21:57 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1" returned: 0 in 0.365s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1 Nov 02 10:21:58 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-2d63fb45-4b1d-4249-816d-a2e94777c607-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Lock "cinder-2d63fb45-4b1d-4249-816d-a2e94777c607-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Acquiring lock "cinder-quobyte-2d63fb45-4b1d-4249-816d-a2e94777c607" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-2d63fb45-4b1d-4249-816d-a2e94777c607" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:58 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-ad7dbc69-619f-40d5-a9da-155c0114daf1" returned: 0 in 0.253s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ea249-9865-490c-bf7f-fb2128ef2706]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Lock "cinder-quobyte-ad7dbc69-619f-40d5-a9da-155c0114daf1" released by "delete_volume" :: held 0.673s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Created reservations ['98531752-32b1-4bd7-a890-d757e039f629', 'd099d52c-b275-4c62-bef1-6d8b4b9099a8', 'bec8390d-3cc7-4f3d-a7ef-5b54954fae69', '88cf9b00-fef2-4f2e-9340-28908d1d1506'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:58 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 Nov 02 10:21:58 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:58 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.251s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:58 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607" returned: 0 in 0.396s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Deleted volume successfully. Nov 02 10:21:58 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607 Nov 02 10:21:58 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-93eaff5c-b6ee-4f91-a08d-7850c0d2c980 tempest-ProjectReaderTests-886906667 None] Lock "cinder-ad7dbc69-619f-40d5-a9da-155c0114daf1-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:58 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-2d63fb45-4b1d-4249-816d-a2e94777c607" returned: 0 in 0.273s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Lock "cinder-quobyte-2d63fb45-4b1d-4249-816d-a2e94777c607" released by "delete_volume" :: held 0.766s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Created reservations ['7fa0d56c-ddc1-4ce9-addf-265bb913621a', '62f609e5-f401-44af-90ed-b8bbb5d9e409', '1e3fa5ce-c22a-48ab-843b-1da4bd211bc4', 'e28c0bc1-5751-4f5e-96cc-35ae2490db61'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:21:59 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Flow 'volume_create_manager' (daedb6bd-1f56-47c9-b99c-27e6fcd28c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3343c917-cc19-47ca-8cee-098533a1a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3343c917-cc19-47ca-8cee-098533a1a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798609032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d872ebc4-f44b-49e6-8433-0dc2da3532da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ce72859146454685f70fcccb2fc9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:59Z,use_quota=True,user_id='717fb8c99c824e4582d1d9d67acaf628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252c8453-e724-4747-9836-47d569992de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252c8453-e724-4747-9836-47d569992de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242fc5be-4956-4011-b284-e4b686ea5b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242fc5be-4956-4011-b284-e4b686ea5b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd872ebc4-f44b-49e6-8433-0dc2da3532da', 'volume_name': 'volume-d872ebc4-f44b-49e6-8433-0dc2da3532da', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d3db1c-70ba-49e0-b3cc-f031603f28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d3db1c-70ba-49e0-b3cc-f031603f28d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff5d81-b34c-4f80-97be-8f24591f17bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:59 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Volume d872ebc4-f44b-49e6-8433-0dc2da3532da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d872ebc4-f44b-49e6-8433-0dc2da3532da', 'volume_size': 1} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798609032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d872ebc4-f44b-49e6-8433-0dc2da3532da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ce72859146454685f70fcccb2fc9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:59Z,use_quota=True,user_id='717fb8c99c824e4582d1d9d67acaf628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Creating volume d872ebc4-f44b-49e6-8433-0dc2da3532da {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:59 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da 1073741824 Nov 02 10:21:59 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.258s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:59 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Deleted volume successfully. Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-15181645-3437-4e38-a578-6e911ce9eabd tempest-ProjectReaderTests-191276047 None] Lock "cinder-2d63fb45-4b1d-4249-816d-a2e94777c607-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:59 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da 1073741824" returned: 0 in 0.447s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da Nov 02 10:21:59 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da" returned: 0 in 0.242s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:59 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff5d81-b34c-4f80-97be-8f24591f17bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d872ebc4-f44b-49e6-8433-0dc2da3532da', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971fbf95-efc9-475d-9d1b-f637ffcbbe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:00 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Volume volume-d872ebc4-f44b-49e6-8433-0dc2da3532da (d872ebc4-f44b-49e6-8433-0dc2da3532da): created successfully Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971fbf95-efc9-475d-9d1b-f637ffcbbe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Flow 'volume_create_manager' (daedb6bd-1f56-47c9-b99c-27e6fcd28c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:00 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-c1808ef8-a39d-43db-80e8-e979300b23f6 tempest-ProjectReaderTests-886906667 None] Created volume successfully. Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Acquiring lock "cinder-d872ebc4-f44b-49e6-8433-0dc2da3532da-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Lock "cinder-d872ebc4-f44b-49e6-8433-0dc2da3532da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Acquiring lock "cinder-quobyte-d872ebc4-f44b-49e6-8433-0dc2da3532da" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Lock "cinder-quobyte-d872ebc4-f44b-49e6-8433-0dc2da3532da" acquired by "delete_volume" :: waited 0.022s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef1a3c7-9c1c-4941-bafb-b3583b53378d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:00 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da Nov 02 10:22:00 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:00 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da" returned: 0 in 0.378s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:00 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da Nov 02 10:22:00 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:00 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:00 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-d872ebc4-f44b-49e6-8433-0dc2da3532da" returned: 0 in 0.266s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Lock "cinder-quobyte-d872ebc4-f44b-49e6-8433-0dc2da3532da" released by "delete_volume" :: held 0.691s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Created reservations ['268c9226-596c-4b2c-a60b-2bd551baede5', 'a8566aa5-6a45-4462-b605-840b475b9dbf', '86a3d998-a113-42cc-8ec0-c6cef141df32', 'db2b79ed-5687-453c-ab49-6a9ba5526093'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:01 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:22:01 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:01 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.265s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:01 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Deleted volume successfully. Nov 02 10:22:01 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-57de42df-a2c8-4be4-af01-78872e9cf51e tempest-ProjectReaderTests-886906667 None] Lock "cinder-d872ebc4-f44b-49e6-8433-0dc2da3532da-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:11 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:INSERT=13,cinder:UPDATE=59,cinder:SELECT=29,cinder:DELETE=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:22:11 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=44,cinder:INSERT=15,cinder:UPDATE=48,cinder:DELETE=5 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Flow 'volume_create_manager' (762bd692-d31f-4486-b05f-6a5be19a2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1dba6d5-73c6-4f49-951a-106461845a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1dba6d5-73c6-4f49-951a-106461845a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1504824630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f95d7d-5853-43d3-bd57-53bdc908a280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb12d52ec684b5f9a74f11b9858cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:36Z,use_quota=True,user_id='c51025b58a344684ad9cf21b7238eb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde8d09-1ba6-4e5a-a95a-2c10fe75a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde8d09-1ba6-4e5a-a95a-2c10fe75a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaa6556-83cc-4bf0-8265-06e36b8f23b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaa6556-83cc-4bf0-8265-06e36b8f23b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f95d7d-5853-43d3-bd57-53bdc908a280', 'volume_name': 'volume-f2f95d7d-5853-43d3-bd57-53bdc908a280', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab00b8-ffe7-4ee6-9038-47391ab3506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab00b8-ffe7-4ee6-9038-47391ab3506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f36547-5307-4d4f-a5e4-0f1b07b58e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:35 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Volume f2f95d7d-5853-43d3-bd57-53bdc908a280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f95d7d-5853-43d3-bd57-53bdc908a280', 'volume_size': 1} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1504824630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f95d7d-5853-43d3-bd57-53bdc908a280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb12d52ec684b5f9a74f11b9858cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:36Z,use_quota=True,user_id='c51025b58a344684ad9cf21b7238eb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)}" {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Creating volume f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:35 devstack cinder-volume[87005]: INFO cinder.volume.drivers.remotefs [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] casted to osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 Nov 02 10:22:35 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 1073741824 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:35 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 1073741824 Nov 02 10:22:35 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:36 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 1073741824" returned: 0 in 0.387s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:36 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 Nov 02 10:22:36 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:36 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280" returned: 0 in 0.236s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'} {{(pid=87005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f36547-5307-4d4f-a5e4-0f1b07b58e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f95d7d-5853-43d3-bd57-53bdc908a280', 'volume_size': 1}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a5da0c-3ec2-4ae3-93b3-57ab32dd16da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:36 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Volume volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 (f2f95d7d-5853-43d3-bd57-53bdc908a280): created successfully Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a5da0c-3ec2-4ae3-93b3-57ab32dd16da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:36 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Flow 'volume_create_manager' (762bd692-d31f-4486-b05f-6a5be19a2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:36 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-350428e2-0018-49db-b11a-56fecd2bd6eb tempest-SnapshotDependencyTests-2056672980 None] Created volume successfully. Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Creating offline snapshot 5c0aaf8f-815e-4e0a-b814-67e43493a2b5 of volume f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96161c-1221-4413-9925-f8aeb9d0bbf9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:37 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 Nov 02 10:22:37 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:37 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280" returned: 0 in 0.347s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 1G {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:37 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 1G Nov 02 10:22:37 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:37 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 1G" returned: 0 in 0.400s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:37 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:37 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 Nov 02 10:22:37 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 -F qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5" returned: 0 in 0.275s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 is being set with open permissions: ugo+rw Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 Nov 02 10:22:38 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5" returned: 0 in 0.227s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.info Nov 02 10:22:38 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.info" returned: 0 in 0.235s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.info is being set with open permissions: ugo+rw Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.info {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.info Nov 02 10:22:38 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.info" returned: 0 in 0.233s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:38 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-ff944eae-57b4-46b2-957b-279f43c303b1 tempest-SnapshotDependencyTests-2056672980 None] Create snapshot completed successfully Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.flows.manager.create_volume [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Flow 'volume_create_manager' (0dfb94e0-3c49-431f-9804-ed0e8ca0e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79434496-d226-47dd-825d-a89779190da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79434496-d226-47dd-825d-a89779190da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bdd34c-baff-4faa-89a4-c78f7cc4f83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb12d52ec684b5f9a74f11b9858cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c0aaf8f-815e-4e0a-b814-67e43493a2b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:40Z,use_quota=True,user_id='c51025b58a344684ad9cf21b7238eb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b712e588-b8fa-4459-a6fe-ee0129adb3ce),volume_type_id=b712e588-b8fa-4459-a6fe-ee0129adb3ce)' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2c1ff4-cfc8-46e9-82da-ed30d07ebe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2c1ff4-cfc8-46e9-82da-ed30d07ebe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd8c240-4e91-420f-a45b-88bed225ebef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd8c240-4e91-420f-a45b-88bed225ebef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12bdd34c-baff-4faa-89a4-c78f7cc4f83c', 'volume_name': 'volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c', 'volume_size': 1, 'snapshot_id': '5c0aaf8f-815e-4e0a-b814-67e43493a2b5'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d7dccb-157e-4161-a41a-190d479a8570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d7dccb-157e-4161-a41a-190d479a8570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d203ac47-b45c-46ee-a19a-da1aafe42c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:39 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Volume 12bdd34c-baff-4faa-89a4-c78f7cc4f83c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c', 'volume_size': 1, 'snapshot_id': '5c0aaf8f-815e-4e0a-b814-67e43493a2b5'} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-quobyte-5c0aaf8f-815e-4e0a-b814-67e43493a2b5-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" by "_create_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-5c0aaf8f-815e-4e0a-b814-67e43493a2b5-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Creating volume 12bdd34c-baff-4faa-89a4-c78f7cc4f83c from snapshot 5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Selected osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9 as target Quobyte volume. {{(pid=87005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-quobyte-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" by "_copy_volume_from_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] snapshot: 5c0aaf8f-815e-4e0a-b814-67e43493a2b5, volume: 12bdd34c-baff-4faa-89a4-c78f7cc4f83c, {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd98873-130c-46f7-8cdf-f5c9ba7e65fe]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:39 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:39 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 Nov 02 10:22:39 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:40 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5" returned: 0 in 0.341s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f95d7d-5853-43d3-bd57-53bdc908a280(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f4cdb-96e8-494c-9d4f-6bbf0a7d2e9d]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:40 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 Nov 02 10:22:40 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:40 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280" returned: 0 in 0.346s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Creating direct copy from snapshot {{(pid=87005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG cinder.utils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Path /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c not found in is_blk_device check {{(pid=87005) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:22:40 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:40 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c Nov 02 10:22:40 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" returned: 0 in 5.694s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG cinder.image.image_utils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Image conversion details: src /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c {{(pid=87005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:22:46 devstack cinder-volume[87005]: INFO cinder.image.image_utils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Converted 1024.00 MB image at 179.80 MB/s Nov 02 10:22:46 devstack cinder-volume[87005]: WARNING cinder.volume.drivers.remotefs [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c is being set with open permissions: ugo+rw Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:46 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c Nov 02 10:22:46 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" returned: 0 in 0.230s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" released by "_copy_volume_from_snapshot" :: held 6.689s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-5c0aaf8f-815e-4e0a-b814-67e43493a2b5-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" released by "_create_volume_from_snapshot" :: held 6.752s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.766s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d203ac47-b45c-46ee-a19a-da1aafe42c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c', 'volume_size': 1, 'snapshot_id': '5c0aaf8f-815e-4e0a-b814-67e43493a2b5'}' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d254f98f-aeff-43e6-a2da-8211b3dcb4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:46 devstack cinder-volume[87005]: INFO cinder.volume.flows.manager.create_volume [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Volume volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c (12bdd34c-baff-4faa-89a4-c78f7cc4f83c): created successfully Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d254f98f-aeff-43e6-a2da-8211b3dcb4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87005) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:46 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Flow 'volume_create_manager' (0dfb94e0-3c49-431f-9804-ed0e8ca0e196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87005) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:46 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-445bbb9f-b4f3-411a-a8d0-86a7ccfcf55f tempest-SnapshotDependencyTests-2056672980 None] Created volume successfully. Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-5c0aaf8f-815e-4e0a-b814-67e43493a2b5-delete_snapshot" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-5c0aaf8f-815e-4e0a-b814-67e43493a2b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-quobyte-f2f95d7d-5853-43d3-bd57-53bdc908a280" by "delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-f2f95d7d-5853-43d3-bd57-53bdc908a280" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-quobyte-5c0aaf8f-815e-4e0a-b814-67e43493a2b5" by "_delete_snapshot" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-5c0aaf8f-815e-4e0a-b814-67e43493a2b5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Deleting offline snapshot 5c0aaf8f-815e-4e0a-b814-67e43493a2b5 of volume f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] snapshot_file for this snap is: volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cad1ad-328d-4956-9160-f7cb55ff1435]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:47 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 Nov 02 10:22:47 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:47 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5" returned: 0 in 0.346s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f95d7d-5853-43d3-bd57-53bdc908a280(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0a8c02-e053-4de5-b249-b47b85d175e9]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:47 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:47 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 Nov 02 10:22:47 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:48 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280" returned: 0 in 0.492s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:48 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 Nov 02 10:22:48 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:48 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5" returned: 0 in 0.314s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:48 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5 Nov 02 10:22:48 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:48 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280.5c0aaf8f-815e-4e0a-b814-67e43493a2b5" returned: 0 in 0.242s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-5c0aaf8f-815e-4e0a-b814-67e43493a2b5" released by "_delete_snapshot" :: held 1.490s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-f2f95d7d-5853-43d3-bd57-53bdc908a280" released by "delete_snapshot" :: held 1.511s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Created reservations ['9611bad4-1b73-4d09-bd98-5f2815a83d26', 'c663f063-7fed-43bf-bf3d-c5996d8e7734', 'd3691213-e6ad-4b0f-b5ec-012ab40dc8dd', 'd104a26b-6601-4485-a12b-165ec7de07c5'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:48 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:22:48 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:48 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Delete snapshot completed successfully. Nov 02 10:22:48 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-9fcc1742-89b2-427b-b18a-ee457cb09faa tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-5c0aaf8f-815e-4e0a-b814-67e43493a2b5-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:49 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.247s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG oslo_service.periodic_task [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] Running periodic task VolumeManager._thread_info {{(pid=87005) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread count: 28 {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG cinder.volume.manager [None req-e6b0cb5f-0fa4-46ee-b377-6d339b539e5d None None] thread info: [<_MainThread(MainThread, started 135241033781376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-f2f95d7d-5853-43d3-bd57-53bdc908a280-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-f2f95d7d-5853-43d3-bd57-53bdc908a280-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-quobyte-f2f95d7d-5853-43d3-bd57-53bdc908a280" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-f2f95d7d-5853-43d3-bd57-53bdc908a280" acquired by "delete_volume" :: waited 0.017s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcec902-e589-44b4-a4aa-a06052195079]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:49 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 Nov 02 10:22:49 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:49 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280" returned: 0 in 0.332s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:49 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:49 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280 Nov 02 10:22:49 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:50 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-f2f95d7d-5853-43d3-bd57-53bdc908a280" returned: 0 in 0.231s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-f2f95d7d-5853-43d3-bd57-53bdc908a280" released by "delete_volume" :: held 0.628s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Created reservations ['3ba8c8c2-8d7b-4604-9ad9-812aaaa2900d', '3a8d5512-6550-476b-bd47-485df61a4049', 'f3408211-3b2c-4c99-84e4-03753ce6e610', '2bfd622f-671a-4d3b-82b5-fc928d779f66'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:50 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:22:50 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:50 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.233s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:50 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Deleted volume successfully. Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-4a55fdaa-3c34-4c3e-82f6-2659eeebabcb tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-f2f95d7d-5853-43d3-bd57-53bdc908a280-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-12bdd34c-baff-4faa-89a4-c78f7cc4f83c-delete_volume" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-12bdd34c-baff-4faa-89a4-c78f7cc4f83c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "cinder-quobyte-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" by "delete_volume" {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" acquired by "delete_volume" :: waited 0.016s {{(pid=87005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a090b-cf4d-4d85-8803-4beda8dba3fc]: (4, 'qcow2') {{(pid=87797) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:50 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:50 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c Nov 02 10:22:50 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" returned: 0 in 0.357s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:51 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c Nov 02 10:22:51 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9/volume-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" returned: 0 in 0.254s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-quobyte-12bdd34c-baff-4faa-89a4-c78f7cc4f83c" released by "delete_volume" :: held 0.655s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG cinder.quota [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Created reservations ['5eda8d8b-5203-460a-aad5-2090c4db927e', '42678334-270d-4ab3-8531-ab99b2e20540', 'a53cd0a7-9cdf-4c26-a580-d7ac847010a5', '25e84380-41c3-4d4c-ac2b-8f6f92b070ae'] {{(pid=87005) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9': None} {{(pid=87005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG cinder.volume.drivers.quobyte [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-397e4626-9d6b-4208-91b5-0f24102a5ff9'] {{(pid=87005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.lockutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87005) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:51 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9 Nov 02 10:22:51 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG oslo_concurrency.processutils [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15972d8201a67e1a077a8b0b091d68a9" returned: 0 in 0.233s {{(pid=87005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG cinder.manager [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Notifying Schedulers of capabilities ... {{(pid=87005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:51 devstack cinder-volume[87005]: INFO cinder.volume.manager [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Deleted volume successfully. Nov 02 10:22:51 devstack cinder-volume[87005]: DEBUG cinder.coordination [None req-132cf04a-bd60-48a7-bd96-3fc1370c879b tempest-SnapshotDependencyTests-2056672980 None] Lock "cinder-12bdd34c-baff-4faa-89a4-c78f7cc4f83c-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87005) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:01 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:23:01 devstack cinder-volume[87005]: DEBUG dbcounter [-] [87005] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}